=========== Storage report for DR1 =========== DR1 DRSUs Attached: 2 DRSU Selected: 2 DRSU1: /dev/md127 Barcode: S15TCV22S0001 Total Storage: 13971.24 GB Remaining Storage: 13272.60 GB Usage: 5.0% File Counts: DRSU2: /dev/md126 (Selected) Barcode: S10TCC13S0023 Total Storage: 9314.18 GB Remaining Storage: 6270.92 GB Usage: 32.7% File Counts: Rec: 13 files Spec: 4 files =========== Storage report for DR2 =========== DR2 DRSUs Attached: 2 DRSU Selected: 2 DRSU1: /dev/md127 Barcode: S10TCC13S0019 Total Storage: 9314.14 GB Remaining Storage: 8848.39 GB Usage: 5.0% File Counts: DRSU2: /dev/md126 (Selected) Barcode: S15TCV22S0002 Total Storage: 13971.23 GB Remaining Storage: 239.60 GB Usage: 98.3% File Counts: Rec: 33 files Spec: 28 files =========== Storage report for DR3 =========== DR3 DRSUs Attached: 2 DRSU Selected: 2 DRSU1: /dev/md127 Barcode: S10TCC13S0024 Total Storage: 9314.18 GB Remaining Storage: 6193.04 GB Usage: 33.5% File Counts: Rec: 8 files Spec: 2 files DRSU2: /dev/md126 (Selected) Barcode: S15TCV22S0003 Total Storage: 13971.24 GB Remaining Storage: 8614.96 GB Usage: 38.3% File Counts: Rec: 18 files Spec: 27 files =========== Storage report for DR4 =========== DR4 DRSUs Attached: 2 DRSU Selected: 1 DRSU1: /dev/md127 (Selected) Barcode: S10TCC13S0015 Total Storage: 9314.18 GB Remaining Storage: 7511.33 GB Usage: 19.4% File Counts: Rec: 3 files Spec: 2 files DRSU2: /dev/md126 Barcode: S15TCV22S0004 Total Storage: 13971.24 GB Remaining Storage: 202.38 GB Usage: 98.6% File Counts: Rec: 37 files Spec: 26 files =========== Storage report for DR5 =========== DR5 DRSUs Attached: 2 DRSU Selected: 2 DRSU1: /dev/md0 Barcode: S10TCC13S0006 Total Storage: 9314.18 GB Remaining Storage: 8848.39 GB Usage: 5.0% File Counts: DRSU2: /dev/md127 (Selected) Barcode: S10TCC13S0025 Total Storage: 9314.18 GB Remaining Storage: 6312.86 GB Usage: 32.2% File Counts: Rec: 26 files ./runLO001.py -t 01:00:00 -d 2013/12/10 19800 LO001_131210_0115_0170_B2.sdf LO001_131210_0115_0171_B3.sdf LO001_131210_0115_0172_B4.sdf 131210 01:14:55 56636 4495332 T 23813 3 DR2 SPC 056636_000023813|(3.8G) 131210 01:14:55 56636 4495227 T 23814 3 DR3 SPC 056636_000023814|(6.9G) 131210 01:14:55 56636 4495332 T 23812 3 DR4 SPC 056636_000023812|(3.9G) LE002_131210_0656_0294_B3.sdf LE002_131210_0656_0295_B4.sdf 131210 06:55:55 56636 24955187 T 24990 3 DR3 REC 056636_000024990|(266G) 131210 06:55:55 56636 24955246 T 24991 3 DR4 REC 056636_000024991|(266G) ./runLO001.py -t 08:00:00 -d 2013/12/10 12600 LO001_131210_0815_0173_B2.sdf LO001_131210_0815_0174_B3.sdf LO001_131210_0815_0175_B4.sdf 131210 08:14:55 56636 29695173 T 25870 3 DR2 SPC 056636_000025870|(4.2G) 131210 08:14:55 56636 29695244 T 25871 3 DR3 SPC 056636_000025871|(4.2G) 131210 08:14:55 56636 29695244 T 25872 3 DR4 SPC 056636_000025872|(4.2G) at 04:45 12/10/13 -f setASP_full.sh (job 1762) 05:01 - 0530 AM 5.1 MHz TBN 05:30 - 06:00 AM 29.9 MHz TBN 06:00 - 06:30 AM 5.1 MHz TBN 06:30 - 07:00 AM 29.9 TBN 07:00 - 07:30 AM 29.9 DRX Beam LL001_131210_1200_0054_TBN.sdf 131210 11:59:55 56636 43195208 T 26692 3 DR5 REC 056636_000026692|(14G) LL001_131210_1205_0058_TBN.sdf 131210 12:04:55 56636 43495147 T 26713 3 DR5 REC 056636_000026713|(890G) LL001_131210_1400_0055_B2.sdf LL001_131210_1400_0056_B3.sdf LL001_131210_1400_0057_B4.sdf 131210 13:59:55 56636 50395284 T 27111 3 DR2 REC 056636_000027111|(39G) 131210 13:59:55 56636 50395186 T 27113 3 DR3 REC 056636_000027113|(39G) 131210 13:59:55 56636 50395284 T 27112 3 DR4 REC 056636_000027112|(39G) at 07:37 12/10/13 -f INIdp.sh (job 1764) at 07:40 12/10/13 -f setASP_split.sh (job 1763) at 11:15 12/10/13 -f INIdp.sh (job 1769) LD002_131210_1834_0045_B2.sdf LD002_131210_1834_0046_B4.sdf 131210 18:33:56 56636 66836256 T 28106 3 DR2 REC 056636_000028106|(531G) 131210 18:33:56 56636 66836181 T 28107 3 DR4 REC 056636_000028107|(531G) LD002_131210_2036_0047_B2.sdf LD002_131210_2036_0048_B4.sdf 131210 20:36:08 56636 74168274 T 29262 3 DR2 REC 056636_000029262|(531G) 131210 20:36:08 56636 74168378 T 29263 3 DR4 REC 056636_000029263|(531G) at 15:55 12/10/13 -f INIdp.sh LD002_131210_2306_0049_B2.sdf LD002_131210_2306_0050_B4.sdf 131210 23:06:13 56636 83173321 T 30456 3 DR2 REC 056636_000030456|(531G) 131210 23:06:13 56636 83173255 T 30457 3 DR4 REC 056636_000030457|(531G) at 18:10 12/10/13 -f INIdp.sh (jon 1784) ./runLO001.py -t 01:00:00 -d 2013/12/11 19800 LO001_131211_0115_0176_B2.sdf LO001_131211_0115_0177_B3.sdf LO001_131211_0115_0178_B4.sdf 131211 01:14:55 56637 4495235 T 32353 3 DR2 SPC 056637_000032353| 131211 01:14:55 56637 4495324 T 32354 3 DR3 SPC 056637_000032354| 131211 01:14:55 56637 4495323 T 32355 3 DR4 SPC 056637_000032355| LE002_131211_0652_0296_B3.sdf LE002_131211_0652_0297_B4.sdf 131211 06:51:55 56637 24715223 T 33511 3 DR3 REC 056637_000033511| 131211 06:51:55 56637 24715168 T 33512 3 DR4 REC 056637_000033512| ./runLO001.py -t 08:00:00 -d 2013/12/11 10800 LO001_131211_0815_0179_B2.sdf LO001_131211_0815_0180_B3.sdf LO001_131211_0815_0181_B4.sdf 131211 08:14:55 56637 29695226 T 34406 3 DR2 SPC 056637_000034406| 131211 08:14:55 56637 29695315 T 34407 3 DR3 SPC 056637_000034407| 131211 08:14:55 56637 29695226 T 34408 3 DR4 SPC 056637_000034408| CORRUPT? LD002_131211_1114_0043_B2.sdf LD002_131211_1114_0044_B4.sdf 131211 11:14:13 56637 40453356 T 35036 3 DR2 REC 056637_000035036| 131211 11:14:13 56637 40453265 T 35037 3 DR4 REC 056637_000035037| at 13:40 12/11/13 -f INIdp.sh (job 1786) LD002_131211_2058_0051_B2.sdf LD002_131211_2058_0052_B4.sdf 131211 20:58:44 56637 75524435 T 41732 3 DR2 REC 056637_000041732|(531G) 131211 20:58:44 56637 75524351 T 41733 3 DR4 REC 056637_000041733|(531G) at 16:00 12/11/13 -f INIdp.sh (job 1787) at 16:10 12/11/13 -f startTBN.sh (job 1788) **DRSUs swapped ./runLO001.py -t 03:30:00 -d 2013/12/12 10800 LO001_131212_0345_0182_B2.sdf LO001_131212_0345_0183_B3.sdf LO001_131212_0345_0184_B4.sdf 131212 03:44:55 56638 13495307 T 43512 3 DR2 SPC 056638_000043512|(137M) 131212 03:44:55 56638 13495149 T 43513 3 DR3 SPC 056638_000043513|(3.5G) 131212 03:44:55 56638 13495199 T 43514 3 DR4 SPC 056638_000043514|(152M) LE002_131212_0648_0298_B3.sdf LE002_131212_0648_0299_B4.sdf 131212 06:47:55 56638 24475192 T 44159 3 DR3 REC 056638_000044159|(266G) 131212 06:47:55 56638 24475134 T 44160 3 DR4 REC 056638_000044160|(266G) ./runLO001.py -t 07:55:00 -d 2013/12/12 16200 LO001_131212_0810_0185_B2.sdf LO001_131212_0810_0186_B3.sdf LO001_131212_0810_0187_B4.sdf 131212 08:09:55 56638 29395249 T 45039 3 DR2 SPC 056638_000045039|(5.6G) 131212 08:09:55 56638 29395249 T 45040 3 DR3 SPC 056638_000045040|(5.6G) 131212 08:09:55 56638 29395188 T 45041 3 DR4 SPC 056638_000045041|(5.6G) at 05:25 12/12/13 -f startTBN.sh (job 1797) at 16:10 12/12/13 -f INIdp.sh (job 1798) LS003_131212_2324_836_B1.sdf LS003_131212_2324_837_B2.sdf LS003_131212_2324_838_B3.sdf LS003_131212_2324_839_B4.sdf 131212 23:24:25 56638 84265990 T 56677 3 DR1 REC 056638_000056677|(266G) 131212 23:24:25 56638 84265202 T 56678 3 DR2 REC 056638_000056678|(266G) 131212 23:24:25 56638 84265136 T 56679 3 DR3 REC 056638_000056679|(266G) 131212 23:24:25 56638 84265202 T 56680 3 DR4 REC 056638_000056680|(265G) Correlator Crashed LD002_131213_0036_0053_B2.sdf LD002_131213_0036_0054_B4.sd 131213 00:36:14 56639 2174170 T 56952 3 DR2 REC 056639_000056952|(266G) 131213 00:36:14 56639 2174104 T 56953 3 DR4 REC 056639_000056953|(266G) ./runLO001.py -t 01:40:00 -d 2013/12/13 20400 LO001_131213_0155_0188_B2.sdf LO001_131213_0155_0189_B3.sdf LO001_131213_0155_0190_B4.sdf 131213 01:54:55 56639 6895297 T 57779 3 DR2 SPC 056639_000057779|(7.2G) 131213 01:54:55 56639 6895230 T 57780 3 DR3 SPC 056639_000057780|(7.2G) 131213 01:54:55 56639 6895297 T 57781 3 DR4 SPC 056639_000057781|(7.2G) LR001_131213_0727_0212_B1.sdf LR001_131213_0727_0213_B3.sdf 131213 07:27:00 56639 26820382 T 58936 3 DR1 REC 056639_000058936|(266G) 131213 07:27:00 56639 26820286 T 58937 3 DR3 REC 056639_000058937|(266G) LR001_131213_0813_0205_B2.sdf LR001_131213_0813_0206_B4.sdf 131213 08:13:10 56639 29590290 T 59579 3 DR2 REC 056639_000059579|(266G) 131213 08:13:10 56639 29590290 T 59580 3 DR4 REC 056639_000059580|(266G) ./runLO001.py -t 09:15:00 -d 2013/12/13 11700 LO001_131213_0930_0194_B2.sdf LO001_131213_0930_0195_B3.sdf LO001_131213_0930_0196_B4.sdf 131213 09:29:55 56639 34195227 T 60102 3 DR2 SPC 056639_000060102|(3.8G) 131213 09:29:55 56639 34195169 T 60103 3 DR3 SPC 056639_000060103|(3.8G) 131213 09:29:55 56639 34195227 T 60104 3 DR4 SPC 056639_000060104|(3.8G) at 05:30 12/13/2013 -f startTBN.sh (job 1817) at 05:50 12/13/2013 -f startTBN.sh (jon 1812) at 09:15 12/13/2013 -f INIdp.sh(job 1813) LR001_131213_1629_0207_B1.sdf LR001_131213_1629_0208_B3.sdf 131213 16:29:28 56639 59368314 T 61556 3 DR1 REC 056639_000061556|(266G) 131213 16:29:28 56639 59368254 T 61557 3 DR3 REC 056639_000061557|(266G) LR001_131213_1648_0209_B2.sdf LR001_131213_1648_0210_B4.sdf 131213 16:48:18 56639 60498273 T 61740 3 DR2 REC 056639_000061740|(266G) 131213 16:48:18 56639 60498219 T 61741 3 DR4 REC 056639_000061741|(266G) at 10:50 12/13/2013 -f INIdp.sh (job 1814) at 11:03 12/13/2013 -f startTBN.sh (job 1815) at 16:05 12/13/2013 -f INIdp.sh (job 1816) LS003_131213_2320_840_B1.sdf LS003_131213_2320_841_B2.sdf LS003_131213_2320_842_B3.sdf LS003_131213_2320_843_B4.sdf 131213 23:20:25 56639 84025256 T 63709 3 DR1 REC 056639_000063709|(266G) 131213 23:20:25 56639 84025256 T 63710 3 DR2 REC 056639_000063710|(266G) 131213 23:20:25 56639 84025256 T 63711 3 DR3 REC 056639_000063711|(266G) 131213 23:20:25 56639 84025174 T 63712 3 DR4 REC 056639_000063712|(266G) ./runLO001.py -t 00:25:00 -d 2013/12/14 22200 LO001_131214_0040_0197_B2.sdf LO001_131214_0040_0198_B3.sdf LO001_131214_0040_0199_B4.sdf 131214 00:39:55 56640 2395296 T 64005 3 DR2 SPC 056640_000064005|(7.8G) 131214 00:39:55 56640 2395296 T 64006 3 DR3 SPC 056640_000064006|(92M) 131214 00:39:55 56640 2395211 T 64007 3 DR4 SPC 056640_000064007|(7.8G) LE002_131214_0640_0300_B3.sdf LE002_131214_0640_0301_B4.sdf 131214 06:39:55 56640 23995283 T 65247 3 DR3 REC 056640_000065247|(266G) 131214 06:39:55 56640 23995188 T 65248 3 DR4 REC 056640_000065248|(266G) ./runLO001.py -t 07:45:00 -d 2013/12/14 11700 LO001_131214_0800_0200_B2.sdf LO001_131214_0800_0201_B3.sdf LO001_131214_0800_0202_B4.sdf 131214 07:59:55 56640 28795258 T 66128 3 DR2 SPC 056640_000066128|(3.8G) 131214 07:59:55 56640 28795175 T 66129 3 DR3 SPC 056640_000066129|(3.8G) 131214 07:59:55 56640 28795258 T 66127 3 DR4 SPC 056640_000066127|(3.8G) at 16:02 12/14/2013 -f INIdp.sh (job 1826) LS003_131214_2317_844_B1.sdf LS003_131214_2317_845_B2.sdf LS003_131214_2317_846_B3.sdf LS003_131214_2317_847_B4.sdf 131214 23:16:55 56640 83815144 T 69293 3 DR1 REC 056640_000069293|(266G) 131214 23:16:55 56640 83815230 T 69294 3 DR2 REC 056640_000069294|(266G) 131214 23:16:55 56640 83815230 T 69295 3 DR3 REC 056640_000069295|(266G) 131214 23:16:55 56640 83815230 T 69296 3 DR4 REC 056640_000069296|(266G) Imager node locked up ./runLO001.py -t 00:20:00 -d 2013/12/15 5700 LO001_131215_0035_0203_B2.sdf LO001_131215_0035_0204_B3.sdf LO001_131215_0035_0205_B4.sdf 131215 00:34:55 56641 2095356 T 69572 3 DR2 SPC 056641_000069572|(1.5G) 131215 00:34:55 56641 2095286 T 69573 3 DR3 SPC 056641_000069573|(1.5G) 131215 00:34:55 56641 2095356 T 69574 3 DR4 SPC 056641_000069574|(1.5G) LS002_131215_0200_1012_B1.sdf LS002_131215_0159_1013_B2.sdf LS002_131215_0200_1014_B3.sdf LS002_131215_0158_1007_B4.sdf 131215 02:00:03 56641 7203393 T 69894 3 DR1 REC 056641_000069894|(266G) 131215 01:59:24 56641 7164223 T 69886 3 DR2 REC 056641_000069886|(266G) 131215 02:00:24 56641 7224281 T 69902 3 DR3 REC 056641_000069902|(266G) 131215 01:58:37 56641 7117231 T 69879 3 DR4 REC 056641_000069879|(266G) *No metadata generated -- MCS/Exec crashed LS002_131215_0304_1008_B1.sdf LS002_131215_0305_1009_B2.sdf LS002_131215_0304_1010_B3.sdf LS002_131215_0304_1011_B4.sdf 131215 03:04:46 56641 11086231 T 71046 3 DR1 REC 056641_000071046|(266G) 131215 03:04:55 56641 11095142 T 71051 3 DR2 REC 056641_000071051|(266G) 131215 03:04:34 56641 11074156 T 71041 3 DR3 REC 056641_000071041|(266G) 131215 03:04:27 56641 11067111 T 71036 3 DR4 REC 056641_000071036|(266G) at 21:10 12/14/2013 -f INIdp.sh (job 1833) at 21:18 12/14/2013 -f startTBN.sh (job 1832) at 21:30 12/14/2013 -f setASP_full.sh (job 1831) at 21:45 12/14/2013 -f INIdp.sh (job 1834) ***MCS/Exec crashed. Observations shortened to 1:20, beginning at 06:10 UTC. LH010_131215_0500_0501_B2.sdf LH010_131215_0500_0601_B3.sdf 131215 06:09:55 56641 22195177 T 73024 3 DR2 REC 056641_000073024|(374G) 131215 06:09:55 56641 22195109 T 73025 3 DR3 SPC 056641_000073025|(2.0G) at 00:35 12/15/2013 -f setASP_split.sh (job 1836) ./runLO001.py -t 07:45:00 -d 2013/12/15 15600 LO001_131215_0800_0212_B2.sdf LO001_131215_0800_0213_B3.sdf LO001_131215_0800_0214_B4.sdf 131215 07:59:55 56641 28795305 T 73645 3 DR2 SPC 056641_000073645|(5.3G) 131215 07:59:55 56641 28795304 T 73646 3 DR3 SPC 056641_000073646|(5.3G) 131215 07:59:55 56641 28795187 T 73647 3 DR4 SPC 056641_000073647|(5.3G) at 05:00 12/15/2013 -f startTBN.sh at 15:58 12/15/2013 -f INIdp.sh (job 1845) LS003_131215_2313_848_B1.sdf LS003_131215_2313_849_B2.sdf LS003_131215_2313_850_B3.sdf LS003_131215_2313_851_B4.sdf 131215 23:12:55 56641 83575213 T 76791 3 DR1 REC 056641_000076791|(266G) 131215 23:12:55 56641 83575213 T 76792 3 DR2 REC 056641_000076792|(266G) 131215 23:12:55 56641 83575214 T 76793 3 DR3 REC 056641_000076793|(265G) 131215 23:12:55 56641 83575147 T 76794 3 DR4 REC 056641_000076794|(266G) MCS/Exec crashed ./runLO001.py -t 00:18:00 -d 2013/12/16 16200 LO001_131216_0033_0215_B2.sdf LO001_131216_0033_0216_B3.sdf LO001_131216_0033_0217_B4.sdf 131216 00:32:55 56642 1975231 T 77085 3 DR2 SPC 056642_000077085|(1.4G) 131216 00:32:55 56642 1975173 T 77086 3 DR3 SPC 056642_000077086|(1.4G) 131216 00:32:55 56642 1975173 T 77087 3 DR4 SPC 056642_000077087|(1.5G) ***MCS/exec crashed. LS002_131216_0453_1015_B1.sdf LS002_131216_0454_1016_B2.sdf LS002_131216_0454_1017_B3.sdf LS002_131216_0454_1018_B4.sdf 131216 04:53:50 56642 17630096 T 77987 3 DR1 REC 056642_000077987|(100G) 131216 04:54:07 56642 17647177 T 77993 3 DR2 REC 056642_000077993|(99G) 131216 04:54:09 56642 17649108 T 77994 3 DR3 REC 056642_000077994|(4.0K) ***MCS/exec crashed LS002_131216_0603_1019_B1.sdf LS002_131216_0603_1020_B2.sdf LS002_131216_0603_1021_B3.sdf LS002_131216_0604_1022_B4.sdf 131216 06:03:35 56642 21815219 T 78177 3 DR1 REC 056642_000078177|(133G) 131216 06:03:33 56642 21813273 T 78175 3 DR2 REC 056642_000078175|(266G) 131216 06:03:33 56642 21813193 T 78176 3 DR3 REC 056642_000078176|(265G) at 00:10 12/16/2013 -f setASP_full.sh (job 1850) LH010_131216_0715_0502_B2.sdf LH010_131216_0715_0602_B3.sdf 131216 07:14:55 56642 26095265 T 78396 3 DR2 REC 056642_000078396|(550G) 131216 07:14:55 56642 26095198 T 78397 3 DR3 SPC 056642_000078397|(2.9G) at 02:20 12/16/2013 -f setASP_split.sh (job 1851) ./runLO001.py -t 09:22:00 -d 2013/12/16 10800 at 05:25 12/16/2013 -f startTBN.sh (job 1860) LO001_131216_0937_0221_B2.sdf LO001_131216_0937_0222_B3.sdf LO001_131216_0937_0223_B4.sdf 131216 09:36:55 56642 34615222 T 79850 3 DR2 SPC 056642_000079850|(3.5G) 131216 09:36:55 56642 34615161 T 79851 3 DR3 SPC 056642_000079851|(3.5G) 131216 09:36:55 56642 34615223 T 79852 3 DR4 SPC 056642_000079852|(3.5G) MCS/exec crashed MCS/exec crashed Imager node locked up