09 March 2012

Busy afternoon for ATLAS Storage at the RAL T1

Lunchtime on the 8th March 2012 was a busy time for the disk servers in the ATLAS instance of CASTOR at the Tier1 at RAL. Servers were delivering approximately 45Gbps as a source:



FTS controlled transfers at this as controlled by the RAL FTS WAN transfers were negligible; since the majority of "WAN" transfer via FTS (RAL) system were actually an intra-CASTOR transfer.

"WAN Rate"


"Intra-CASTOR" rate shown below shows that of the 4-5GB/s only 2.5Gbps is internal FTS traffic. ( ~5% of traffic.)

However this is only ~1/3 of the outbound traffic over the WAN. The other traffic is controlled by other FTS servers.
ATLAS aggregate this into the following ATLAS specific plot:
This shows the outbound traffic was actually 625MB/s (~5Gbps)
 ATLAS have a graph showing amount of data processed . This peaked at over 8TB in one hour.


However 8TB/hour is approximately 25Gbps
So what was using the remaining bandwidth...

Well we also need to include traffic from disk servers to tape servers (which are LAN transfers that neither ATLAS nor FTS know about. This rate can be seen here:


This shows there is an extra 600MB/s (~5Gbps) of rate unaccounted for. With FTS+WN+Tape network loads; the known bandwidth usage is 35Gbps. As a rough estimation, this explains how the majority of the bandwidth was used.

08 March 2012

I have been quiet for a while so thought I just give a sit-rep regarding my numbers. I am in 91 houses; 283 rooms in total. The houses (and the number of rooms) in which I and my children currently stay are:
1 CA-MCGILL-CLUMEQ-T2
1 CSTCDIE
1 CYFRONET-LCG2
1 IL-TAU-HEP
1 INFN-ROMA3
1 INFN-TRIESTE
1 MAIGRID
1 NCG-INGRID-PT
1 RO-02-NIPNE
1 RO-07-NIPNE
1 RRC-KI
1 SMU
1 TUDRESDEN-ZIH
1 UKI-LT2-UCL-HEP
1 UKI-SOUTHGRID-CAM-HEP
1 UNIBE-LHEP
1 UNI-BONN
1 UNICPH-NBI
1 UNIGE-DPNC
1 UPENN
1 VICTORIA-LCG2
1 WISC
2 AUSTRALIA-ATLAS
2 BEIJING-LCG2
2 CA-ALBERTA-WESTGRID-T2
2 CSCS-LCG2
2 ILLINOISHEP
2 IN2P3-CPPM
2 INFN-BOLOGNA-T3
2 INFN-FRASCATI
2 LIP-COIMBRA
2 LIP-LISBON
2 NERSC
2 OU
2 RU-PROTVINO-IHEP
2 SE-SNIC-T2
2 TR-10-ULAKBIM
2 UAM-LCG2
2 UKI-NORTHGRID-SHEF-HEP
2 UKI-SOUTHGRID-BHAM-HEP
3 GOEGRID
3 GRIF-LPNHE
3 IFAE
3 IN2P3-LPC
3 IN2P3-LPSC
3 JINR-LCG2
3 PIC
3 SARA-MATRIX
3 SFU-LCG2
3 UKI-LT2-RHUL
3 UKI-NORTHGRID-MAN-HEP
3 UKI-SCOTGRID-ECDF
3 UKI-SOUTHGRID-OX-HEP
3 WEIZMANN-LCG2
4 AGLT2
4 CA-SCINET-T2
4 CA-VICTORIA-WESTGRID-T2
4 FZK-LCG2
4 GRIF-IRFU
4 GRIF-LAL
4 IFIC-LCG2
4 IN2P3-LAPP
4 INFN-T1
4 LRZ-LMU
4 MPPMU
4 MWT2
4 NET2
4 PRAGUELCG2
4 RAL-LCG2
4 SWT2
4 UKI-LT2-QMUL
4 UKI-NORTHGRID-LANCS-HEP
4 UKI-NORTHGRID-LIV-HEP
4 UKI-SCOTGRID-GLASGOW
4 UKI-SOUTHGRID-RALPP
4 UNI-FREIBURG
4 WUPPERTALPROD
5 DESY-ZN
5 INFN-MILANO-ATLASC
5 INFN-NAPOLI-ATLAS
5 INFN-ROMA1
5 TAIWAN-LCG2
6 DESY-HH
6 SLACXRD
6 TRIUMF-LCG2
7 NIKHEF-ELPROD
7 TOKYO-LCG2
8 BNL-OSG2
8 IN2P3-CC
8 NDGF-T1
10 CERN-PROD

The type (and number) of rooms of each type in which my children and I live:
1 DATAPREP
1 DET-LARG
1 DET-MUON
1 PERF-MUONS
1 PPSDATADISK
1 TMPLOCALGROUPDISK
1 TZERO
2 CALIBDISK
3 PERF-EGAMMA
4 PERF-JETS
4 PERF-TAU
5 PERF-FLAVTAG
5 PHYS-EXOTICS
5 TRIG-DAQ
5 USERDISK
6 PHYS-BEAUTY
7 PHYS-HIGGS
8 DATATAPE
9 PHYS-SUSY
9 PHYS-TOP
11 PHYS-SM
55 SCRATCHDISK
56 LOCALGROUPDISK
71 DATADISK

As you can see the type and number of each type of room vary quite alot.

I have 1445 unique children (but over 2700 in total including clones.) Some of my children have up to 16 clones, worringly 989 of my children have no clones at all , should any on my houses or rooms become destroyed many may be lost. Since I am the unique ancestor of all of them, all are reproducable (with various amounts of effort.)

287/636 of the unique Dirks have no clones and 43/57 of the unique Gavins have no clones. These are the easiest to reproduce; as they are produced en mass centrally. However, 659/753 of the unique Ursalas have no clones and are the highest risk children to be able to be reproduced. If only we could get Ursalas' avatar owners to create more clones of them.

In total; my children are 218863 files and 47.065TB of data; whereas I was 15200 files and ~16TB. I.e my children are ~3 times my size; but 14 times my number of files. Of my children; 42TB (143k files) are Dirk's; 1TB(37k files) are Gavin's. Ursula's make up the remaining 5TB/ 3k Files.
My birthday calendar looks like:
Day Apr May Jun Jul Aug Sep Oct Nov Dec Jan Feb Mar
1
9
1 1
1 5 4 3 6 16
2
1 31
2
1 2 3 3 7 4
3
3 5 1

4
1 2 4 16
4

21 1

2 6 2 6 7 7
5
2



3 7 2 3 7 2
6
2
1
2 10 1 5 5 19 13
7




2 1 1 3 1 8 7
8




3
5 5
9
9
1
12
5

3 2 18
10
1 4

2
2 5 2 11
11
1 1 1 2 4
1 8 22 9
12
5
5 1 2 2 3 10 5 3
13
4
6 2 1 4 4 4 6 5
14
6 2 1

3 1 7 6 6
15

3 5 1 5 2 1 3 3 6
16
1 3
4 4 2 2 7 2 5
17

3 3 17 4 1

2 9
18
1 1 2 27 1 1
2 7 11
19



37
1
8 8 7
20
2

7

3 5
18
21
2

6
3 4 1 5 13
22

1
17 5 2 3 2 6 17
23
1 1 8 7 11 1 3 7 10 13
24

1 6 8 3 1 5 2 6 21
25 30 2 4 2 10 2 3 9
5 20
26
3
2 14 6 4 10 2 6 13
27 13 1
1 14 3 5 2 1 3 14
28 36

1 1
7 1
5 7
29 62 14 1 2
2 5 4 9 7 9
30 6
12 1

4 5 2 11

31


4

1
2 9


So you can see there was a busy period around my birth; then in the second half of August; and relatively busy again in the last six weeks.