UTC 120828 17:43 -- MCS/TP PC reboot UTC 120828 17:45 -- MCS/sch started UTC 120828 18:05 -- ASP settings reasserted (split bandwidth config per operator manual): $ ./mesix ASP FIL 00000 # split BW $ ./mesix ASP ATS 00015 # 30 dB atten $ ./mesix ASP AT1 00008 # 16 dB atten $ ./mesix ASP AT2 00006 # 12 dB atten UTC 120828 18:12 -- MCS/exec started me_make_gf(): Stands marked out: 9 13 15 34 36 40 58 66 84 96 98 121 123 124 133 148 163 165 182 187 203 214 217 231 232 237 244 257 259 260 me_make_gf(): 30 of 260 stands marked out UTC 120828 18:24 -- checking storage $ ./generateFullStorageReport.sh =========== Storage report for DR1 =========== DR1 DRSUs Attached: 2 DRSU selected: 2 DRSU1: /dev/md0 Barcode: 'S10TCC13S0005:LWA' Total Storage: 9315.08 GB Remaining Storage: 9315.05 GB Contiguous Storage: 9315.08 GB Usage: 0% File Count: 0 files DRSU2: /dev/md1 Barcode: 'S15TCV13S0006:LWA' Total Storage: 13972.59 GB Remaining Storage: 13972.56 GB Contiguous Storage: 13972.59 GB Usage: 0% File Count: 0 files =========== Storage report for DR2 =========== DR2 DRSUs Attached: 2 DRSU selected: 1 DRSU1: /dev/md0 Barcode: 'S15TCV13S0003:LWA' Total Storage: 13972.59 GB Remaining Storage: 13703.51 GB Contiguous Storage: 13703.51 GB Usage: 1.00% File Count: 2 files DRSU2: /dev/md1 Barcode: 'S10TCC13S0016:LWA' Total Storage: 9315.08 GB Remaining Storage: 9315.05 GB Contiguous Storage: 9315.08 GB Usage: 0% File Count: 0 files =========== Storage report for DR3 =========== DR3 DRSUs Attached: 2 DRSU selected: 2 DRSU1: /dev/md0 Barcode: 'S10TCC13S0022:LWA' Total Storage: 9315.08 GB Remaining Storage: 9315.05 GB Contiguous Storage: 9315.08 GB Usage: 0% File Count: 0 files DRSU2: /dev/md1 Barcode: 'S15TCV12S0001:LWA' Total Storage: 13972.59 GB Remaining Storage: 13972.56 GB Contiguous Storage: 13972.59 GB Usage: 0% File Count: 0 files =========== Storage report for DR4 =========== DR4 DRSUs Attached: 2 DRSU selected: 1 DRSU1: /dev/md0 Barcode: 'S15TCV12S0004:LWA' Total Storage: 13972.59 GB Remaining Storage: 13972.56 GB Contiguous Storage: 13972.59 GB Usage: 0% File Count: 0 files DRSU2: /dev/md1 Barcode: 'S10TCC13S0004:LWA' Total Storage: 9315.08 GB Remaining Storage: 9315.05 GB Contiguous Storage: 9315.08 GB Usage: 0% File Count: 0 files =========== Storage report for DR5 =========== DR5 DRSUs Attached: 1 DRSU selected: 1 DRSU1: /dev/md0 Barcode: 'S10TCC13S0021:LWA' Total Storage: 9315.08 GB Remaining Storage: 9257.55 GB Contiguous Storage: 9257.55 GB Usage: 0% File Count: 6 files UT 120828 2036 -- Commanded DP_ SHT to forestall apparent icing problem UT 120828 2352 -- DP_ INI UT 120828 2357 -- TBN restart at 52 MHz UT 120829 0244 -- DP_ SHT/INI to turn off TBN in prep for DRX tests UT 120829 0343 -- Ran script 120829_CygA_0443.sh Cyg A drift scan at transit -- failed/unusable due to errors in script UT 120829 0711 -- Ran script 120829_CasA_0811.sh Cas A drift scan at transit -- failed/unusable due to errors in script UT 120829 0955 -- DP_ INI; TBN restarted at 52 MHz UT 120829 1201 -- DP_ SHT/INI to stop TBN in prep for beam runs UT 120829 1313 -- Ran script 120829_TauA_UC.sh 3-beam Tau A drift scan at transit in spectrometer mode Intermittent FPGA temp warnings; max about 82 degC but seems OK otherwise. Will continue to monitor. UT 120829 1529 -- DP_ SHT/INI to turn off beams in prep for TBN restart UT 120829 1533 -- TBN restarted at 52 MHz UT 1208329 2357 -- Compiled SSMIF_120829.dat -- implements new pointing correction UT 120830 0001 -- MCS/exec restarted using above as new SSMIF me_make_gf(): Stands marked out: 9 13 15 34 36 40 58 66 84 96 98 121 123 124 133 148 163 165 182 187 203 214 217 231 232 237 244 257 259 260 me_make_gf(): 30 of 260 stands marked out UT 120830 0221 -- SHL has been non-responsive for a long time hours, at least. Finally Joe Craig logged in via a "back door", power cycled it, and now it's back. Did SHL INI. UT 120830 0221 -- DP_ SHT, DP_ INI to stop TBN in prep for beamforming runs. Took 2 tries to INI UT 120830 0335 -- Ran script 120830_CygA_0335.sh (3-beam drift scan) Unusable due to error in script UT 120830 0659 -- Ran script 120830_CasA_0759.sh (3-beam drift scan) Failed due to error in script UT 120830 1003 -- DP_ SHT/INI to turn off beams in prep for TBN restart UT 120830 1008 -- TBN restart at 52 MHz UT 120830 1900 -- Running LT002_0830_1900_0001.TB.sdf UT 120830 1918 -- DR5 not responding to MCS, ssh, or IP ping. Was OK at last check (1912) UT 120830 1950 -- DR5 back up after power cycling by Jayce Dowell UT 120830 2000 -- LT002_0830_1900_0001.TB.sdf is still running; I manually started a new recording to finish it out. New file tag ends in 10518. DR crashed again shortly after starting this recording. UT 120830 2012 -- TBN frequency restored to 52 MHz and default gain setting using ./startTBN.sh UT 120830 2030 -- looks like 2012 TBN restart didn't work. Doing DP_ SHT/INI followed by ./startTBN.sh again That didn't work either. Greg says PASI doesn't work unless DR5 is alive(?) UT 120831 0258 -- DP_ SHT to try to get some thermal headroom for upcoming beam observations UT 120831 0311 -- Ran script 120831_CygA_UC.sh successful UT 120831 0540 -- Ran script 120831_DO_COMM_SE.sh UT 120831 0655 -- Ran script 120831_CasA_UC.sh successful UT 120831 0902 -- DP_ SHT to forestall morning icing UT 120831 1204 -- DP_ INI in prep for upcoming DRX-mode run UT 120831 1305 -- Ran script 120831_TauA_UC.sh successful UT 120831 1525 -- DP_ SHT/INI to turn off beams in prep for TBN restart TBN restarted at 52 MHz UT 120831 17:19 -- Executed JC's script setARX_full.sh -- looks like ASP gagged on it (many missing responses); sent commands in smaller groups and that seemed to work. UT 120831 17:27 -- ./mesix DP_ TBN "16500000 7 15 0"; in prep for LT002; changed to ./mesix DP_ TBN "16500000 7 20 0" works better -- no clipping according to http://www.phys.unm.edu/~lwa/tbnhists.html UT 120831 18:23 -- DR5 is incommunicado. Apparently Ken O is replacing the eSATA board. UT 120831 18:53 -- DR5 appears to be back up UT 120831 1900 -- Running LT002_0831_1900_0002.TB.sdf. filetag 056170_000015440 UT 120901 0000 (approx) -- DP_ SHT UT 120901 0012 -- Restored standard split-bandwidth settings for all ARXs UT 120901 0239 -- DP_ INI UT 120901 0240 -- TBN restarted at 52 MHz UT 120901 0306 -- DP_ INI in prep for DRX runs UT 120901 0327 -- Ran script 120901_BO_COMM_SE.sh tag=056171_000017177 tag=056171_000017181 UT 120901 0536 -- Ran script 120901_DO_COMM_SE.sh 056171_000017627 056171_000017631 UT 120901 0651 -- Ran script 120901_CasA_UC.sh 056171_000017890 056171_000017894 056171_000017898 UT 120901 0903 -- DP_ SHT UT 120901 1243 -- DP_ INI UT 120901 1331 -- Ran SDF LE002_120901_1331_0105_B_GP.sdf tag=056171_000019269 UT 120901 1331 -- Ran script 120901_TauA_BO_COMM_SE.sh tag=056171_000019264 tag=056171_000019268 UT 120901 1435 -- DP_ SHT, DP_ INI to shut off beams UT 120901 1444 -- TBN restart at 52 MHz UT 120901 1815 -- DRSU storage report: $ ./generateFullStorageReport.sh =========== Storage report for DR1 =========== DR1 DRSUs Attached: 2 DRSU selected: 2 DRSU1: /dev/md0 Barcode: 'S10TCC13S0005:LWA' Total Storage: 9315.08 GB Remaining Storage: 9315.05 GB Contiguous Storage: 9315.08 GB Usage: 0% File Count: 0 files DRSU2: /dev/md1 Barcode: 'S15TCV13S0006:LWA' Total Storage: 13972.59 GB Remaining Storage: 13972.56 GB Contiguous Storage: 13972.59 GB Usage: 0% File Count: 0 files =========== Storage report for DR2 =========== DR2 DRSUs Attached: 2 DRSU selected: 1 DRSU1: /dev/md0 Barcode: 'S15TCV13S0003:LWA' Total Storage: 13972.59 GB Remaining Storage: 13407.89 GB Contiguous Storage: 13407.89 GB Usage: 4.00% File Count: 4 files DRSU2: /dev/md1 Barcode: 'S10TCC13S0016:LWA' Total Storage: 9315.08 GB Remaining Storage: 9315.05 GB Contiguous Storage: 9315.08 GB Usage: 0% File Count: 0 files =========== Storage report for DR3 =========== DR3 DRSUs Attached: 2 DRSU selected: 2 DRSU1: /dev/md0 Barcode: 'S10TCC13S0022:LWA' Total Storage: 9315.08 GB Remaining Storage: 9315.05 GB Contiguous Storage: 9315.08 GB Usage: 0% File Count: 0 files DRSU2: /dev/md1 Barcode: 'S15TCV12S0001:LWA' Total Storage: 13972.59 GB Remaining Storage: 13650.37 GB Contiguous Storage: 13650.37 GB Usage: 2.00% File Count: 4 files =========== Storage report for DR4 =========== DR4 DRSUs Attached: 2 DRSU selected: 1 DRSU1: /dev/md0 Barcode: 'S15TCV12S0004:LWA' Total Storage: 13972.59 GB Remaining Storage: 13677.68 GB Contiguous Storage: 13677.68 GB Usage: 2.00% File Count: 3 files DRSU2: /dev/md1 Barcode: 'S10TCC13S0004:LWA' Total Storage: 9315.08 GB Remaining Storage: 9315.05 GB Contiguous Storage: 9315.08 GB Usage: 0% File Count: 0 files =========== Storage report for DR5 =========== DR5 DRSUs Attached: 1 DRSU selected: 1 DRSU1: /dev/md0 Barcode: 'S10TCC13S0021:LWA' Total Storage: 9315.08 GB Remaining Storage: 6076.05 GB Contiguous Storage: 6076.05 GB Usage: 34.00% File Count: 10 files DR1 Used Avail /dev/sdf1 2.0T 685G 1.2T 37% /media/borman DR2 /dev/sda1 2.0T 731G 1.2T 40% /media/kitching DR3 /dev/sdf1 2.0T 2.0T 0 100% /media/kiker DR4 /dev/sda1 2.0T 331G 1.6T 18% /media/kennedy DR5 /dev/sda1 2.0T 367G 1.6T 20% /media/lovell UT 120901 1953 -- TBN reset to 74.03 MHz, gain 19 UT 120902 0353 -- ./mesix DR5 REC "56172 13980000 3600000 DEFAULT_TBN" Cyg A transit; MT 21:53 / ET 23:53 / UT 3:53-4:23-4:53 tag = 056172_000022579 UT 120902 0500 -- ./mesix DP_ TBN "40900000 7 20 0" ./mesix DR5 REC "56172 18000000 3600000 DEFAULT_TBN" (TBN, 40.9 MHz, Gain 20; Starts about 0.5 hours after Cyg A tranit) (MT 23:00 / ET 01:00 / UT 05:00) tag = 056172_000023045 UT 120902 0903 -- DP_ SHT UT 120902 ???? -- DP_ INI UT 120902 1327 -- CGP run with B0329+54 anticoincidence; completed with no issues LE002_120902_1327_0106_B_GP.sdf LE002_120902_1327_0107_B_GP.sdf LE002_120902_1327_0108_B_GP.sdf UT 120902 1534 -- DP_ INI UT 120902 1536 -- TBN started at 52 MHz UT 120902 1622 -- Shut down MCS/exec and MCS/sch in prep for installation of sch logging patch UT 120902 1635 -- MCS/Sch restart with logging patch installed UT 120902 1636 -- MCS/exec started me_make_gf(): Stands marked out: 9 13 15 34 36 40 58 66 84 96 98 121 123 124 133 148 163 165 182 187 203 214 217 231 232 237 244 257 259 260 me_make_gf(): 30 of 260 stands marked out UT 120902 1659 -- DP_ SHT for deicing in prep for upcoming run UT 120902 1733 -- DP_ INI UT 120902 1808 -- Ran script 120902_Sun_UC.sh tag = 056172_000000337 tag = 056172_000000341 tag = 056172_000000345 UT 120902 2010 -- DP_ SHT; DP_ INI UT 120902 2018 -- command line gain-setting test on DR1. Not worth saving. # ./mesix DP_ DRX "1 1 37900000 7 3 0" # 37.90 MHz, 19.6 MSPS, Gain=3 ./mesix DP_ DRX "1 2 74030000 7 3 0" # 74.03 MHz, 19.6 MSPS, Gain=3 ./mesix DP_ BAM "1 740_886_0452.df fringe_254stand_258ref.gf 0" # 254 on X, 258 on Y ./mesix DR1 REC "56172 73080000 10000 DRX_FILT_7" # Dur 10s, tag=056172_000000784 ==> not enough code toggling # ./mesix DP_ DRX "1 1 37900000 7 0 0" # 37.90 MHz, 19.6 MSPS, Gain=0 ./mesix DP_ DRX "1 2 74030000 7 0 0" # 74.03 MHz, 19.6 MSPS, Gain=0 ./mesix DP_ BAM "1 740_886_0452.df fringe_254stand_258ref.gf 0" # 254 on X, 258 on Y ./mesix DR1 REC "56172 74100000 10000 DRX_FILT_7" # 20:35, Dur 10s, tag=056172_00000860 ==> too much clipping # ./mesix DP_ DRX "1 1 37900000 7 2 0" # 37.90 MHz, 19.6 MSPS, Gain=2 ./mesix DP_ DRX "1 2 74030000 7 2 0" # 74.03 MHz, 19.6 MSPS, Gain=2 ./mesix DP_ BAM "1 740_886_0452.df fringe_254stand_258ref.gf 0" # 254 on X, 258 on Y ./mesix DR1 REC "56172 75000000 10000 DRX_FILT_7" # 20:50, Dur 10s, tag=056172_00000917 ==> looks pretty good; could go higher. UT 120902 2057 -- DP_ INI; TBN restart at 52 MHz UT 120903 0233 -- DP_ INI in prep for upcoming beam runs. (DP has been shutdown for last 1/2 hour or so) UT 120903 0320 -- at 21:18 09/02/12 -f 120903_CygA_BO_COMM_SE.sh # ./mesix DP_ DRX "2 1 37900000 7 2 0" # 37.90 MHz, 19.6 MSPS, Gain=2 ./mesix DP_ DRX "2 2 74030000 7 2 0" # 74.03 MHz, 19.6 MSPS, Gain=2 ./mesix DP_ BAM "2 740_822_0071.df 120901_bo.gf 0" # beam_X on X, 258_X on Y Cyg A pointing ./mesix DR2 REC "56173 12000000 7200000 DRX_FILT_7" # Dur 2h, tag=056173_000002259 # ./mesix DP_ DRX "3 1 37900000 7 2 0" # 37.90 MHz, 19.6 MSPS, Gain=2 ./mesix DP_ DRX "3 2 74030000 7 2 0" # 74.03 MHz, 19.6 MSPS, Gain=2 ./mesix DP_ BAM "3 740_886_0452.df fringe_254stand_258ref.gf 0" # 254_X on X, 258_X on Y, zenith delays ./mesix DR3 REC "56173 12000000 7200000 DRX_FILT_7" # Dur 2h, tag=056173_000002263 # ./mesix DP_ DRX "4 1 37900000 7 2 0" # 37.90 MHz, 19.6 MSPS, Gain=2 ./mesix DP_ DRX "4 2 74030000 7 2 0" # 74.03 MHz, 19.6 MSPS, Gain=2 ./mesix DP_ BAM "4 740_886_0452.df fringe_252stand_258ref.gf 0" # 252_X on X, 258_X on Y, zenith delays ./mesix DR4 REC "56173 12000000 7200000 DRX_FILT_7" # Dur 2h, tag=056173_000002267