2023-08-04 18:27:04 [WARNING ] Received signal 15 SIGTERM
2023-08-04 18:27:04 [INFO    ] Shutdown, waiting for threads to join
2023-08-04 18:27:07 [INFO    ] All done
2023-08-05 02:31:59 [INFO    ] Starting /usr/local/bin/adp_drx.py with PID 4060
2023-08-05 02:31:59 [INFO    ] Cmdline args: "--tuning 1 --configfile /usr/local/share/adp/adp_config.json --logfile /home/adp/log/adp-drx-1.adp2.log"
2023-08-05 02:31:59 [INFO    ] Version:      0.2
2023-08-05 02:31:59 [INFO    ] Current MJD:  60161.105544
2023-08-05 02:31:59 [INFO    ] Current MPM:  9119000
2023-08-05 02:31:59 [INFO    ] Config file:  /usr/local/share/adp/adp_config.json
2023-08-05 02:31:59 [INFO    ] Log file:     /home/adp/log/adp-drx-1.adp2.log
2023-08-05 02:31:59 [INFO    ] Dry run:      False
2023-08-05 02:31:59 [INFO    ] Waiting to get UTC_START
2023-08-05 02:32:20 [INFO    ] UTC_START:    2023_08_05T02_32_26
2023-08-05 02:32:20 [INFO    ] Hostname:     adp2
2023-08-05 02:32:20 [INFO    ] Server index: 1
2023-08-05 02:32:20 [INFO    ] Src address:  mcg40s2-data:4016
2023-08-05 02:32:20 [INFO    ] TBF address:  mcg40-dr1:10000
2023-08-05 02:32:20 [INFO    ] COR address:  orville:11000
2023-08-05 02:32:20 [INFO    ] TNG address:  adp-data:4016
2023-08-05 02:32:20 [INFO    ] Roaches:      1-16
2023-08-05 02:32:20 [INFO    ] Tunings:      2 (of 2)
2023-08-05 02:32:20 [INFO    ] CPUs:         8 9 10 11 12
2023-08-05 02:32:20 [INFO    ] GPUs:         1
2023-08-05 02:32:55 [INFO    ] Launching 5 thread(s)
2023-08-05 02:32:55 [INFO    ] Not for us: 1 -> 0 @ 1
2023-08-05 02:32:56 [INFO    ] Copy: Start of new sequence: {'time_tag': 331475744096000000, 'seq0': 750000, 'chan0': 1100, 'nchan': 132, 'cfreq': 29137500.0, 'bw': 3300000.0, 'nstand': 256, 'npol': 2, 'complex': True, 'nbit': 4}
2023-08-05 02:32:56 [INFO    ] Beamformer: New sequence configuration received
2023-08-05 02:32:56 [INFO    ]   Complex gains set - beam 1
2023-08-05 02:32:56 [INFO    ]   Complex gains set - beam 2
2023-08-05 02:32:56 [INFO    ] Retransmit: Start of new sequence: {'time_tag': 331475744096000000, 'seq0': 750000, 'chan0': 1100, 'nchan': 132, 'cfreq': 29137500.0, 'bw': 3300000.0, 'nstand': 2, 'npol': 2, 'complex': True, 'nbit': 32}
2023-08-05 02:36:27 [WARNING ] Received signal 15 SIGTERM
2023-08-05 02:36:27 [INFO    ] Shutdown, waiting for threads to join
2023-08-05 02:36:30 [INFO    ] All done
2023-08-05 02:37:31 [INFO    ] Starting /usr/local/bin/adp_drx.py with PID 8332
2023-08-05 02:37:31 [INFO    ] Cmdline args: "--tuning 1 --configfile /usr/local/share/adp/adp_config.json --logfile /home/adp/log/adp-drx-1.adp2.log"
2023-08-05 02:37:31 [INFO    ] Version:      0.2
2023-08-05 02:37:31 [INFO    ] Current MJD:  60161.109387
2023-08-05 02:37:31 [INFO    ] Current MPM:  9451000
2023-08-05 02:37:31 [INFO    ] Config file:  /usr/local/share/adp/adp_config.json
2023-08-05 02:37:31 [INFO    ] Log file:     /home/adp/log/adp-drx-1.adp2.log
2023-08-05 02:37:31 [INFO    ] Dry run:      False
2023-08-05 02:37:31 [INFO    ] Waiting to get UTC_START
2023-08-05 02:37:55 [INFO    ] UTC_START:    2023_08_05T02_38_03
2023-08-05 02:37:55 [INFO    ] Hostname:     adp2
2023-08-05 02:37:55 [INFO    ] Server index: 1
2023-08-05 02:37:55 [INFO    ] Src address:  mcg40s2-data:4016
2023-08-05 02:37:55 [INFO    ] TBF address:  mcg40-dr1:10000
2023-08-05 02:37:55 [INFO    ] COR address:  orville:11000
2023-08-05 02:37:55 [INFO    ] TNG address:  adp-data:4016
2023-08-05 02:37:55 [INFO    ] Roaches:      1-16
2023-08-05 02:37:55 [INFO    ] Tunings:      2 (of 2)
2023-08-05 02:37:55 [INFO    ] CPUs:         8 9 10 11 12
2023-08-05 02:37:55 [INFO    ] GPUs:         1
2023-08-05 02:37:58 [INFO    ] Launching 5 thread(s)
2023-08-05 02:38:03 [INFO    ] Copy: Start of new sequence: {'time_tag': 331475804464000000, 'seq0': 25000, 'chan0': 132, 'nchan': 132, 'cfreq': 4937500.0, 'bw': 3300000.0, 'nstand': 256, 'npol': 2, 'complex': True, 'nbit': 4}
2023-08-05 02:38:03 [INFO    ] Beamformer: New sequence configuration received
2023-08-05 02:38:03 [INFO    ]   Complex gains set - beam 1
2023-08-05 02:38:03 [INFO    ]   Complex gains set - beam 2
2023-08-05 02:38:03 [INFO    ] Retransmit: Start of new sequence: {'time_tag': 331475804464000000, 'seq0': 25000, 'chan0': 132, 'nchan': 132, 'cfreq': 4937500.0, 'bw': 3300000.0, 'nstand': 2, 'npol': 2, 'complex': True, 'nbit': 32}
2023-08-05 02:38:09 [INFO    ] Copy: Start of new sequence: {'time_tag': 331475805514560000, 'seq0': 159000, 'chan0': 1100, 'nchan': 132, 'cfreq': 29137500.0, 'bw': 3300000.0, 'nstand': 256, 'npol': 2, 'complex': True, 'nbit': 4}
2023-08-05 02:38:09 [INFO    ] Beamformer: New sequence configuration received
2023-08-05 02:38:09 [INFO    ]   Complex gains set - beam 1
2023-08-05 02:38:09 [INFO    ]   Complex gains set - beam 2
2023-08-05 02:38:09 [INFO    ] Retransmit: Start of new sequence: {'time_tag': 331475805514560000, 'seq0': 159000, 'chan0': 1100, 'nchan': 132, 'cfreq': 29137500.0, 'bw': 3300000.0, 'nstand': 2, 'npol': 2, 'complex': True, 'nbit': 32}
2023-08-05 02:38:29 [INFO    ] Not for us: 1 -> 0 @ 1
2023-08-05 02:39:24 [INFO    ] Not for us: 1 -> 0 @ 1
2023-08-05 02:40:27 [INFO    ] Not for us: 1 -> 0 @ 1
2023-08-05 02:43:02 [INFO    ] Copy: Start of new sequence: {'time_tag': 331475862970000000, 'seq0': 7487500, 'chan0': 2736, 'nchan': 132, 'cfreq': 70037500.0, 'bw': 3300000.0, 'nstand': 256, 'npol': 2, 'complex': True, 'nbit': 4}
2023-08-05 02:43:02 [INFO    ] Beamformer: New sequence configuration received
2023-08-05 02:43:02 [INFO    ]   Complex gains set - beam 1
2023-08-05 02:43:02 [INFO    ]   Complex gains set - beam 2
2023-08-05 02:43:02 [INFO    ] Retransmit: Start of new sequence: {'time_tag': 331475862970000000, 'seq0': 7487500, 'chan0': 2736, 'nchan': 132, 'cfreq': 70037500.0, 'bw': 3300000.0, 'nstand': 2, 'npol': 2, 'complex': True, 'nbit': 32}
2023-08-05 02:44:03 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 02:44:03 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:10:14 [INFO    ] Beamformer: New sequence configuration received
2023-08-05 06:10:14 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:10:14 [INFO    ]   Complex gains set - beam 2
2023-08-05 06:10:14 [INFO    ] Retransmit: Start of new sequence: {'time_tag': 331478299563600000, 'seq0': 318277500, 'chan0': 2697, 'nchan': 132, 'cfreq': 69062500.0, 'bw': 3300000.0, 'nstand': 2, 'npol': 2, 'complex': True, 'nbit': 32}
2023-08-05 06:10:17 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:10:17 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:10:23 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:10:23 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:10:29 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:10:29 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:10:35 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:10:35 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:10:41 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:10:41 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:10:47 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:10:47 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:10:53 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:10:53 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:10:59 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:10:59 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:11:05 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:11:05 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:11:11 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:11:11 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:11:17 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:11:17 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:11:23 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:11:23 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:11:29 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:11:29 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:11:35 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:11:35 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:11:41 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:11:41 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:11:47 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:11:47 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:11:53 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:11:53 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:11:59 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:11:59 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:12:05 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:12:05 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:12:11 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:12:11 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:12:17 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:12:17 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:12:23 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:12:23 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:12:29 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:12:29 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:12:35 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:12:35 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:12:41 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:12:41 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:12:47 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:12:47 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:12:53 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:12:53 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:12:59 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:12:59 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:13:05 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:13:05 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:13:11 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:13:11 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:13:17 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:13:17 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:13:23 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:13:23 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:13:29 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:13:29 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:13:35 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:13:35 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:13:41 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:13:41 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:13:47 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:13:47 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:13:53 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:13:53 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:13:59 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:13:59 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:14:05 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:14:05 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:14:11 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:14:11 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:14:17 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:14:17 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:14:23 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:14:23 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:14:29 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:14:29 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:14:35 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:14:35 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:14:41 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:14:41 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:14:47 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:14:47 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:14:53 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:14:53 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:14:59 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:14:59 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:15:05 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:15:05 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:15:11 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:15:11 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:15:17 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:15:17 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:15:23 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:15:23 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:15:29 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:15:29 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:15:35 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:15:35 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:15:41 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:15:41 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:15:47 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:15:47 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:15:53 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:15:53 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:15:59 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:15:59 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:16:05 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:16:05 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:16:11 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:16:11 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:16:17 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:16:17 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:16:23 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:16:23 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:16:29 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:16:29 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:16:35 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:16:35 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:16:41 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:16:41 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:16:47 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:16:47 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:16:53 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:16:53 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:16:59 [INFO    ] Beamformer: New configuration received for beam 1 (delta = 0.0 subslots)
2023-08-05 06:16:59 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:19:02 [INFO    ] Beamformer: New sequence configuration received
2023-08-05 06:19:02 [INFO    ]   Complex gains set - beam 1
2023-08-05 06:19:02 [INFO    ]   Complex gains set - beam 2
2023-08-05 06:19:02 [INFO    ] Retransmit: Start of new sequence: {'time_tag': 331478403071200000, 'seq0': 331480000, 'chan0': 2736, 'nchan': 132, 'cfreq': 70037500.0, 'bw': 3300000.0, 'nstand': 2, 'npol': 2, 'complex': True, 'nbit': 32}
