<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE oplog SYSTEM "http://lda10g.alliance.unm.edu/metadata/oplog/DTD/oplog.dtd">
<?xml-stylesheet type="text/xsl" href="http://lda10g.alliance.unm.edu/metadata/oplog/XSL/oplog.xsl"?>
<oplog operator="Jeff Richards" render="2013-11-15T21:06:03" version="1.0">
  <date when="2013-07-01T00:00:00">
    <comments>Jeff Richards taking over

=========== Storage report for DR1 ===========
DR1
DRSUs Attached: 2
DRSU selected: 2
DRSU1: /dev/md127
  Barcode:            ''S10TCC13S0008''
  Total Storage:      9315.08 GB
  Remaining Storage:  8848.38 GB
  Usage:              5.00%
  File Count:         0 files
DRSU2: /dev/md0
  Barcode:            'UNREADABLE'
  Total Storage:      13972.59 GB
  Remaining Storage:  5193.01 GB
  Usage:              62.00%
  File Count:         60 files
=========== Storage report for DR2 ===========
DR2
DRSUs Attached: 2
DRSU selected: 2
DRSU1: /dev/md127
  Barcode:            ''S10TCC13S0014''
  Total Storage:      9315.08 GB
  Remaining Storage:  8847.69 GB
  Usage:              5.00%
  File Count:         0 files
DRSU2: /dev/md126
  Barcode:            ''S15TCV12S0002''
  Total Storage:      13972.59 GB
  Remaining Storage:  6624.73 GB
  Usage:              52.00%
  File Count:         29 files
=========== Storage report for DR3 ===========
DR3
DRSUs Attached: 2
DRSU selected: 2
DRSU1: /dev/md127
  Barcode:            ''S10TCC13S0015''
  Total Storage:      9315.08 GB
  Remaining Storage:  8848.38 GB
  Usage:              5.00%
  File Count:         0 files
DRSU2: /dev/md126
  Barcode:            ''S15TCV13S0004''
  Total Storage:      13972.59 GB
  Remaining Storage:  8844.94 GB
  Usage:              36.00%
  File Count:         15 files
=========== Storage report for DR4 ===========
DR4
DRSUs Attached: 2
DRSU selected: 2
DRSU1: /dev/md127
  Barcode:            ''S10TCC13S0023''
  Total Storage:      9315.08 GB
  Remaining Storage:  8848.38 GB
  Usage:              5.00%
  File Count:         0 files
DRSU2: /dev/md126
  Barcode:            ''S15TCV13S0001''
  Total Storage:      13972.59 GB
  Remaining Storage:  3356.88 GB
  Usage:              75.00%
  File Count:         61 files
=========== Storage report for DR5 ===========
DR5
DRSUs Attached: 2
DRSU selected: 1
DRSU1: /dev/md0
  Barcode:            ''S10TCC13S0026''
  Total Storage:      9315.08 GB
  Remaining Storage:  6587.28 GB
  Usage:              29.00%
  File Count:         128 files
DRSU2: /dev/md127
  Barcode:            ''S15TCV12S0003''
  Total Storage:      13972.59 GB
  Remaining Storage:  13272.59 GB
  Usage:              5.00%
  File Count:         0 files</comments>
    <events>
    </events>
  </date>
  <date when="2013-07-02T00:00:00">
    <comments>19:20 MDT - Temps were climbing, excuted low-power mode golow.sh
HVAC showed clear signs of cycling, restarting station 
at 20:54 07/02/13 -f INIdp.sh
Set to full 
at 21:21 07/02/13 -f setASP_full.sh
followed by ./startTBN.sh

22:15 07/01/13 -f INIdp.sh 

LG001_130702_0429_16_B2.sdf
LG001_130702_0429_17_B3.sdf
LG001_130702_0429_18_B4.sdf
130702 04:42:08  56475  16928225 T     68362 3 DR4 RPT Record
130702 04:42:08  56475  16928225 T     68358 3 DR2 RPT Record
130702 04:42:08  56475  16928225 T     68360 3 DR3 RPT Record

at 02:40 07/02/13 -f INIdp.sh (job 741)
at 02:48 07/02/13 -f startTBN.sh (job 744)

at 04:00 07/02/13 -f INIdp.sh (job 745)

LS003_130702_1010_21_B1.sdf
LS003_130702_1010_22_B2.sdf
LS003_130702_1010_23_B3.sdf
LS003_130702_1010_24_B4.sdf
130702 04:28:55  56475  16135125 T     68272 3 DR2 REC 056475_000068272|
130702 04:28:55  56475  16135348 T     68273 3 DR3 REC 056475_000068273|
130702 04:28:55  56475  16135406 T     68274 3 DR4 REC 056475_000068274|


at 05:15 07/02/13 -f INIdp.sh (job 746)
at 05:25 07/02/13 -f startTBN.sh (job 747)

set to split 15:15 UTC

at approx 21:00 UTC went to low power due to storms in the area. Received the all clear 00:15 UTC.

Down time 3.5 hours for lightning</comments>
    <events>
      <problem when="2013-07-02T01:20:00" type="SHL" duration="0:00:00">Temps were climbing, excuted low-power mode golow.sh</problem>
    </events>
  </date>
  <date when="2013-07-03T00:00:00">
    <comments>at 00:30, turend station back on in split

at 01:10 07/03/13 -f INIdp.sh (job 749)
COMJD_130703_0724_CygA_2.sdf
COMJD_130703_0724_CygA_3.sdf
COMJD_130703_0724_CygA_4.sdf

130703 07:24:17  56476  26657133 T     75275 3 DR2 SPC 056476_000075275|  353M
130703 07:24:17  56476  26657401 T     75277 3 DR4 SPC 056476_000075277|  353M
130703 07:24:17  56476  26657857 T     75276 3 DR3 SPC 056476_000075276|  353M 


at 03:35 07/03/13 -f INIdp.sh (job 750)
LS003_130703_1006_25_B1.sdf
LS003_130703_1006_26_B2.sdf
LS003_130703_1006_27_B3.sdf
LS003_130703_1006_28_B4.sdf

130703 10:06:17  56476  36377411 T     75836 3 DR4 REC 056476_000075836|
130703 10:06:17  56476  36377495 T     75834 3 DR2 REC 056476_000075834|
130703 10:06:17  56476  36377495 T     75833 3 DR1 REC 056476_000075833| 177G
130703 10:06:17  56476  36377658 T     75835 3 DR3 REC 056476_000075835|  266G




at 05:10 07/03/13 -f INIdp.sh (job 751)
at 05:20 07/03/13 -f startTBN.sh (job 753)

130703 10:42:08  56476  38528430 T     75970 3 ASP RPT NORMAL|

130703 10:47:22  56476  388420056478_00008603400 T     75987 8 ASP SHT Timed out at subsystem|
130703 10:47:22  56476  38842000 N Previous message: eMIBerror=64

ASP stopped responding, went to low power about 11:45 UTC
Brought back online 14:45 UTC  DOWN TIME, APPROX 3 HRS

LH003_130703_1615_0017_TBN.sdf

130703 16:14:55  56476  58495175 T     77166 3 DR5 REC 056476_000077166|

still in split
ASP went down durning storm 
ASP back online, went into lightning mode</comments>
    <events>
    </events>
  </date>
  <date when="2013-07-04T00:00:00">
    <comments></comments>
    <events>
    </events>
  </date>
  <date when="2013-07-05T00:00:00">
    <comments>No HVAC resopnse cycle for over 7 hours. Went low power to get it going again.

at 18:37 07/04/13 -f golow.sh (job 755) shut down for 30 mins.

at 03:45 07/05/13 -f INIdp.sh
LS003_130705_0958_29_B1.sdf
LS003_130705_0958_30_B2.sdf
LS003_130705_0958_31_B3.sdf
LS003_130705_0958_32_B4.sdf

130705 09:58:25  56478  35905434 T     86037 3 DR4 REC 056478_000086037|  266G
130705 09:58:25  56478  35905542 T     86035 3 DR1 REC 056478_000086035|  266G
130705 09:58:25  56478  35905542 T     86036 3 DR3 REC 056478_000086036|  266G
130705 09:58:25  56478  35905542 T     86034 3 DR2 REC 056478_000086034|  266G

at 05:05 07/05/13 -f INIdp.sh
at 05:15 07/05/13 -f startTBN.sh</comments>
    <events>
      <problem when="2013-07-05T00:00:00" type="SHL" duration="7:00:00">No HVAC resopnse cycle for over 7 hours. Went low power to get it going again.</problem>
    </events>
  </date>
  <date when="2013-07-06T00:00:00">
    <comments>at 22:50 07/05/13 -f INIdp.sh (job 763)
LR001_130706_0500_0128_B2.sdf

130706 04:59:55  56479  17995420 T       479 3 DR2 REC 056479_000000479| 239G

at 00:05 07/06/13 -f INIdp.sh (job 764)
at 05:15 07/05/13 -f startTBN.sh (job 765)

 
at 02:50 07/06/13 -f INIdp.sh (job 766)
LR001_130706_0900_0126_B2.sdf
LR001_130706_0900_0127_B3.sdf 

130706 08:59:55  56479  32395408 T      1408 3 DR2 REC 056479_000001408| 266G
130706 08:59:55  56479  32395665 T      1409 3 DR3 REC 056479_000001409| 259G

at 05:05 07/06/13 -f INIdp.sh (job 767)
at 05:15 07/06/13 -f startTBN.sh (job 768)

at 15:30 MST went to low power due to rising temps and ASP error
at 16:10 powered station back up
Still in split

at 20:40 07/06/13 -f setASP_full.sh (job 770)
02:43:08 startTBN.sh 
./mesix DP_ TBN "37800000 7 18 0"

LH009_130707_0300_0002_TBW.SDF
130707 06:53:55  56480  24835179 T      6665 3 DR5 REC 056480_000006665|
qq
last file tag - 056480_000007561

at 05:08 INIdp.sh
at 05:15 07/07/13 -f ./setASP_split.sh
at 05:16 07/07/13 -f ./startTBN.sh</comments>
    <events>
      <problem when="2013-07-06T21:30:00" type="SHL" duration="0:50:00">went to low power due to rising temps and ASP error</problem>
    </events>
  </date>
  <date when="2013-07-07T00:00:00">
    <comments>LW001_130707_1630_61_S1.sdf  
13:30 056480_000008893| 529M
LW001_130707_1630_62_S2.sdf  
13:30 056480_000008893| 529M
LW001_130707_1630_63_S4.sdf 
13:30 056480_000008895| 529M

3.5 hours shutdown. ASP and DP temps were rising without any sign of cycling. 

LR001_130708_0156_0129_B2.sdf 
20:56 056481_000012463| 266G

LR001_130708_0301_0130_B2.sdf 
22:01 056481_000012781| 266G
LR001_130708_0301_0131_B3.sdf 
21:00 056481_000012782| 266G
./INIdp.sh at 23:10
./startTBN.sh at 23:17

---
DOWNTIME report: down 3.5 hours for high temps on 7/02
                      3   hours for ASP crash  on 7/03
                       .5 hours for high temps on 7/05
                       .5 hours for high temps on 7/06
                      3.5 hours for high temps on 7/07
11 hours total</comments>
    <events>
      <problem when="2013-07-07T00:00:00" type="SHL" duration="3:30:00">ASP and DP temps were rising without any sign of cycling</problem>
    </events>
  </date>
</oplog>
