<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE oplog SYSTEM "http://lda10g.alliance.unm.edu/metadata/oplog/DTD/oplog.dtd">
<?xml-stylesheet type="text/xsl" href="http://lda10g.alliance.unm.edu/metadata/oplog/XSL/oplog.xsl"?>
<oplog operator="Frank Schinzel" render="2013-11-15T21:06:03" version="1.0">
  <date when="2012-11-05T00:00:00">
    <comments>Operator: Frank Schinzel
Start: 11/05/2012 10:10 MST
End: ...

TBN running @ 37.90 MHz

DG001 schedule PSR B1508+55 observation for 11:47 Beam 3 and 4

11:35 MST: Run TBW check
cd MCS/exec
./acquireTBW.py
cd ~/tbwspecs
./runLatestCheck.sh
./checkStatusChanges.sh file.txt

11:40 MST: INI DP

11:42 MST: set ARX full bandwidth
Run set_ASP_full

11:47 MST: (18:47 UTC) DG001 start
Beam 3: 056236_000015867 (265.64 GB)
Beam 4: 056236_000015868 (265.64 GB)

12:47 MST: DG001 stop

12:58 MST: stop beams, commands rejected

12:59 MST: DP_ INI

13:04 MST: set ARX split bandwidth
Run set_ASP_split

13:08 MST: Start TBN split
./startTBN_split38.sh

13:47 MST: Scheduled DG001 to start at 0227</comments>
    <events>
    </events>
  </date>
  <date when="2012-11-06T00:00:00">
    <comments>19:15 MST: DP_ INI
at 19:15 11/5/12 -f INIdp.sh (147)

19:16 MST: set ASP full
at 19:16 11/5/12 -f setASP_full.sh (148)

19:27 MST: Start DG001 Target: PSR B2217+47
Beam 3: 056237_000017835 (265.64 GB)
Beam 4: 056237_000017836 (265.64 GB)

20:27 MST: DG001 ends

20:30 MST: DP_ INI
at 20:30 11/5/12 -f INIdp.sh (151)

at 20:31 11/5/12 -f setASP_split (152)

at 20:45 11/5/12 -f startTBN_split38.sh (153)

at 00:05 11/6/12 -f acquireTBW.py (161)

at 00:20 11/6/12 -f startTBN_split38.sh (162)

at 03:30 11/6/12 -f acquireTBW.py (166) failed?

3:50 acquireTBW.py

at 03:40 11/6/12 -f INIdp.sh (154)

at 03:45 11/6/12 -f setASP_full.sh (155)

04:00 MST LL001 Observation begins
TBN: 056237_000020115 (699.45 GB)

06:00 MST LL001 Observation ends

Beam 4 pulsar obs started before it was suppossed, degrading the last half hour of the TBN LL001 run. PASI didn't recognize frequency for TBN run, didn't run in parallel.  

at 06:02 11/6/12 -f INIdp.sh (156)

06:08 MST LC001 observation begins
Observation lost DP not ready
Beam 1: 056237_000020657 (0 GB)
Beam 2: 056237_000020658 (0 GB)

Beam 4 lost
06:15 MST DG001 observation begins
Beam 3: 056237_000020733 (265.64 GB) - delete
Beam 4: 056237_000020406 (154.41 GB) - delete

Caused by wrong MPM value in beam 4 sdf. Scrubbing LC001/DG001 and delete files from DRSUs

07:15 MST DG001 observation ends

07:48 MST LC001 observation ends

at 07:50 11/6/12 -f INIdp.sh (163)

at 07:51 11/6/12 -f setASP_split.sh (164)

at 08:00 11/6/12 -f startTBN_split38.sh (165)

9:24 MST: 056237_000020733 and 056237_000020406 deleted

10:55 MST: acquire_TBW.py
cd ~/tbwspecs
./runLatestCheck.sh
./checkStatusChanges.sh file.txt

11:01 MST: startTBN_split38.sh

Many bad dipoles that are marked good: There appear to be 79 bad dipoles.
Restarting ASP
11:07 MST: Issues ASP SHT
         ./msei ASP INI 33
         ./setASP_split.sh
         ./mesix ASP FPW 000111
         ./mesix ASP FPW 000211
         ./mesix ASP FPW 259100
         ./mesix ASP FPW 259200

11:12 MST: Repeat TBW capture
Result even worse

Re-initialized ASP again without scripts, TBW capture is OK

Trying to set ASP_split and run TBW capture again
checks out OK

No running setASP_full and run TBW capture again
one bad antenna

Switching back with setASP_split and run TBW capture again
no new bad antennas reported

11:59 MST: continue running PASI

01:19 MST: scheduled LL001 and DG001

echo "python acquireTBW.py" | at 22:00 11/6/12 (171)
no change to dipole health</comments>
    <events>
    </events>
  </date>
  <date when="2012-11-07T00:00:00">
    <comments>3:30 setASP_full.sh
at 03:30 11/7/12 -f setASP_full.sh (172)

3:31 DP_ INI
at 03:31 11/7/12 -f INIdp.sh (173)

3:45 TBW capture
echo "python acquireTBW.py" | at 03:45 11/7/12 (174)
no new bad antennas reported
RFI spectrum cleaner compared to the day before

4:00 LL001 begins
TBN: 056238_000026118 (713.32 GB)

6:00 LL001 ends

6:01 DP_ INI
at 06:01 11/7/12 -f INIdp.sh (175)

6:15 DG001 begins
beam 3: 056238_000026581 (265.64 GB)
beam 4: 056238_000026582 (265.64 GB)

7:15 DG001 ends

7:20 DP_ INI
at 07:20 11/7/12 -f INIdp.sh (176)

7:21 setASP_split.sh
at 07:21 11/7/12 -f setASP_split.sh (177)

7:30 TBW capture
echo "python acquireTBW.py" | at 07:30 11/7/12 (178) 
somehow produced garbage, reran:
nop ne bad antennas reported
stronger low frequency RFI

7:35 start PASI
at 07:35 11/7/12 -f startTBN_split38.sh (179)

11:23 MST: acquireTBW.py
no new bad antennas reported

11:27 MST: DP_ INI

11:33 MST: startTBN_split38.sh

02:26 MST: scheduled LL001 for 2012/11/08

21:30 MST: echo "python acquireTBW.py" | at 21:30 11/7/12 (187)
no status change</comments>
    <events>
    </events>
  </date>
  <date when="2012-11-08T00:00:00">
    <comments>3:30 setASP_full.sh
at 03:30 11/8/12 -f setASP_full.sh (180) 

3:31 DP_ INI
at 03:31 11/8/12 -f INIdp.sh (181)

3:45 TBW capture
echo "python acquireTBW.py" | at 03:45 11/8/12 (182)

4:00 LL001 begins
TBN: 056239_000031481 (713.32 GB) 

6:00 LL001 ends

6:01 DP_ INI
at 06:01 11/8/12 -f INIdp.sh (183)

at 06:05 11/8/12 -f setASP_split.sh (184)

echo "python acquireTBW.py" | at 06:10 11/8/12 (185)

6:15 MST: startTBN_split38.sh
at 06:10 11/8/12 -f startTBN_split38.sh (186)

ASP antennas starting to degrate again, a few bad dipoles need to investigate later

09:04 MST: acquireTBW.py

09:48 MST: manually set filter settings
mesix ASP FIL 00000
mesix ASP AT1 00013
mesix ASP AT2 00013

mesix ASP FIL 00000
mesix ASP ATS 00015
mesix ASP AT1 00008
mesix ASP AT2 00006

acquireTBW.py
no change

try unpowering and repowering FEEs
./mesix ASP FPW 000100
./mesix ASP FPW 000200
./mesix ASP FPW 000111
./mesix ASP FPW 000211
./mesix ASP FPW 259100
./mesix ASP FPW 259200

acquireTBW.py
Reduced 13 bad marked as good -&gt; 5 bad

running setASP_split.py

acquireTBW.py

./mesix ASP SHT
./mesix ASP INI 33
./setASP_split.sh
./mesix ASP FPW 000100
./mesix ASP FPW 000200
./mesix ASP FPW 000111
./mesix ASP FPW 000211
./mesix ASP FPW 259100
./mesix ASP FPW 259200

acquireTBW.py

11:12 MST DP_ INI
Restart TBN startTBN_split38.sh

14:45 DP_ INI
at 14:45 11/8/12 -f INIdp.sh (188)

14:55 at 14:55 11/8/12 -f COMFS_121108_2200_b1.sh (189)

15:00 MST COMFS - Target: 3C 380 begins
beam 1: 056239_000034060 (264.91 GB)
beam 2: 056239_000034082 SPC (201M)
beam 3: 056239_000034083 (265.65 GB)

16:00 MST COMFS ends

16:00 at 16:01 11/8/12 -f COMFS_121108_2305_b1.sh (226)

16:05 COMFS - Target: Cyg A begins
beam 1: 056239_000034301 (264.91 GB)
beam 2: 056239_000034319 SPC (201M)
beam 3: 056239_000034320 (265.65 GB)

16:15 COMKO - Target: GRB
beam 4: 056239_000034361 SPC (668M)

17:05 COMFS ends

19:35 MST COMKO ends
19:35 MST COMKO begins
beam 3: 056240_000035725 SPC (435M) 

at 19:45 11/8/12 -f COMFS_121109_0250_b1.sh (227)

19:50 COMFS - Target: Cas A begins
beam 1: 056240_000035776 (264.91 GB)
beam 2: 056240_000035799 SPEC (201M)
beam 4: 056240_000035800 (265.65 GB)

20:50 COMFS ends

21:45 MST: COMKO ends
at 21:45 11/8/12 -f INIdp.sh (199)

at 21:55 11/8/12 -f COMFS_121109_0500_b1.sh (228)

22:00 COMFS/COMGT begin target 3C48/PSR B0148-06:
beam 1: 056240_000036356 (264.91 GB)
beam 2: 056240_000036375 SPC (201M)
beam 3: 056240_000036376 (265.65 GB)
beam 4: 056240_000036377 (265.65 GB)

23:00 COMFS/COMGT end

23:05 DP_ INI
at 23:05 11/8/12 -f INIdp.sh (201)

at 23:15 11/8/12 -f startTBN_split38.sh (202)

echo "python acquireTBW.py" | at 23:20 11/8/12 (203)</comments>
    <events>
    </events>
  </date>
  <date when="2012-11-09T00:00:00">
    <comments>01:45 MST: DP_ INI
at 01:45 11/9/12 -f INIdp.sh (204)

01:55 MST:
at 01:55 11/9/12 -f COMFS_121109_0900_b1.sh (229)

02:00 MST: COMFS begins, target: Tau A
beam 1: 056240_000037307 (264.91 GB)
beam 2: 056240_000037325 SPC (201M)
beam 4: 056240_000037326 (265.65 GB)

03:00 MST: COMFS ends

03:05 MST: DP_ INI
at 03:05 11/9/12 -f INIdp.sh (206)

at 03:15 11/9/12 -f startTBN_split38.sh (207)

04:15 MST: DP_ INI
at 04:15 11/9/12 -f INIdp.sh (208)

04:30 MST: COMGT begins target: PSR B0820+02
beam 3: 056240_000037852 (265.65 GB)

04:55 MST: at 04:55 11/9/12 -f COMFS_121109_1200_b1.sh (230)

05:00 MST: COMFS begins target: 3C196
beam 1: 056240_000037998 (264.91 GB)
beam 2: 056240_000038028 SPC (201M)
beam 4: 056240_000038029 (265.65 GB)

05:30 MST: COMGT ends

06:00 MST: COMFS ends

06:00 MST: COMGT begins target: PSR B0943+10
beam 3: 056240_000038311 (265.65 GB)

07:00 MST: COMGT ends

07:05 MST: DP_ INI
at 07:05 11/9/12 -f INIdp.sh (210)

at 07:15 11/9/12 -f startTBN_split38.sh (243)

08:40 MST: DP_ INI
at 08:40 11/9/12 -f INIdp.sh (211)

08:50 MST: at 08:50 11/9/12 -f COMFS_121109_1555_b1.sh (231)

08:55 MST: COMFS begins target: Vir A
beam 1: 056240_000039076 (264.91 GB)
beam 2: 056240_000039095 sPC (201M)
beam 3: 056240_000039094 (265.65 GB)

09:55 MST: COMFS ends 
09:55 MST: at 09:55 11/9/12 -f COMFS_121109_1700_b1.sh (232)

10:00 MST: COMFS begins target: 3C286
beam 1: 056240_000039309 (264.91 GB)
beam 2: 056240_000039327 SPC (201M)
beam 3: 056240_000039328 (265.65 GB)

11:00 MST: COMFS ends

11:05 DP_ INI
at 11:05 11/9/12 -f INIdp.sh (214)

11:15 PASI
at 11:15 11/9/12 -f startTBN_split38.sh (215)

11:20 acquireTBW
echo "python acquireTBW.py" | at 11:20 11/9/12 (216)

11:45 DP_ INI
at 11:45 11/9/12 -f INIdp.sh (217)

12:00 COMMGT begins target: PSR B1540-06
beam 4: 056240_000039753 (265.65 GB)
no bams after 19:43

There were some issues with this observation. It caused MCS/exec to shutdown

13:00 COMMGT ends

13:05 DP_ INI
at 13:05 11/9/12 -f INIdp.sh (218)

13:15 PASI
at 13:15 11/9/12 -f startTBN_split38.sh (219)

08:57 Restarting MCS after it shut itself down?

MCS/exec and MCS/sch restarted
LH004 and COMFS rescheduled

23:10 DP_ INI
at 23:00 11/09/12 -f INIdp.sh (244)

23:15 setASPfull.sh
at 23:10 11/09/12 -f configASP_fullBW.sh (245)

23:15 MST LH004 begins
beam 2: 056241_000000434 (795.47 GB)
beam 3: 056241_000000435 (795.47 GB)</comments>
    <events>
    </events>
  </date>
  <date when="2012-11-10T00:00:00">
    <comments>02:15 MST LH004 ends

02:20 DP_ INI
at 02:20 11/10/12 -f INIdp.sh (248)

02:25 setASPsplit
at 02:25 11/10/12 -f configASP_splitBW.sh (249)

02:30 at 02:30 11/10/12 -f startTBN_split38.sh (251)

2:35 MST: acquireTBW.sh
echo "python acquireTBW.py" | at 02:35 11/10/12 (252)

10:15 MST: DP_ INI
at 10:15 11/10/12 -f INIdp.sh (221)

10:25: at 10:25 11/10/12 -f COMFS_121110_1730_b1.sh (233) 

10:30 COMFS begins target: 3C295
beam 1: 056241_000003613 (264.91 GB)
beam 2: 056241_000003631 SPC (201M)
beam 4: 056241_000003632 (265.65 GB)

11:30 COMFS ends

11:35 DP_ INI
at 11:35 11/10/12 -f INIdp.sh (223)

11:50 PASI
at 11:50 11/10/12 -f startTBN_split38.sh (224)

11:55 acquireTBW.sh 
echo "python acquireTBW.py" | at 11:55 11/10/12 (225)

23:00 MST
echo "python acquireTBW.py" | at 23:00 11/10/12 (258)</comments>
    <events>
    </events>
  </date>
  <date when="2012-11-11T00:00:00">
    <comments>08:18 MST DP_ INI


11:35 MST DP_ INI
at 11:35 11/11/12 -f INIdp.sh (254)

11:52 MST COMGT begins, target: PSR B1540-06
beam 4: didn't run

12:52 MST COMGT ends

12:55 MST DP_ INI
at 12:55 11/11/12 -f INIdp.sh (255)

13:05 MST TBN
at 13:05 11/11/12 -f startTBN_split38.sh (256)

13:10 MST acquireTBW
echo "python acquireTBW.py" | at 13:10 11/11/12 (257)

19:19 MST beam former calibration lost DP_ INI

06:46 MST DP_ INI

06:49 MST acquireTBW
all good

10:00 MST handed off station to Chris Wolfe</comments>
    <events>
    </events>
  </date>
</oplog>
