Providing large-scale disk storage at CERN
Clicks: 268
ID: 60127
2019
Article Quality & Performance Metrics
Overall Quality
Improving Quality
0.0
/100
Combines engagement data with AI-assessed academic quality
Reader Engagement
Steady Performance
75.1
/100
265 views
218 readers
Trending
AI Quality Assessment
Not analyzed
Abstract
The CERN IT Storage group operates multiple distributed storage systems and is responsible for the support of the infrastructure to accommodate all CERN storage requirements, from the physics data generated by LHC and non-LHC experiments to the personnel users' files.
EOS is now the key component of the CERN Storage strategy. It allows to operate at high incoming throughput for experiment data-taking while running concurrent complex production work-loads. This high-performance distributed storage provides now more than 250PB of raw disks and it is the key component behind the success of CERNBox, the CERN cloud synchronisation service which allows syncing and sharing files on all major mobile and desktop platforms to provide offline availability to any data stored in the EOS infrastructure. CERNBox recorded an exponential growth in the last couple of year in terms of files and data stored thanks to its increasing popularity inside CERN users community and thanks to its integration with a multitude of other CERN services (Batch, SWAN, Microsoft Office).
In parallel CASTOR is being simplified and transitioning from an HSM into an archival system, focusing mainly in the long-term data recording of the primary data from the detectors, preparing the road to the next-generation tape archival system, CTA.
The storage services at CERN cover as well the needs of the rest of our community: Ceph as data back-end for the CERN OpenStack infrastructure, NFS services and S3 functionality; AFS for legacy home directory filesystem services and its ongoing phase-out and CVMFS for software distribution. In this paper we will summarise our experience in supporting all our distributed storage system and the ongoing work in evolving our infrastructure, testing very-dense storage building block (nodes with more than 1PB of raw space) for the challenges waiting ahead.
| Reference Key |
herv2019providingepj
Use this key to autocite in the manuscript while using
SciMatic Manuscript Manager or Thesis Manager
|
|---|---|
| Authors | Hervé, Rousseau;Belinda, Chan Kwok Cheong;Cristian, Contescu;Xavier, Espinal Curull;Jan, Iven;Hugo, Gonzalez Labrador;Massimo, Lamanna;Giuseppe, Lo Presti;Luca, Mascetti;Jakub, Moscicki;Dan, van der Ster; |
| Journal | epj web of conferences |
| Year | 2019 |
| DOI |
DOI not found
|
| URL | |
| Keywords |
microscopy
Materials of engineering and construction. Mechanics of materials
Technology (General)
Chemical technology
Engineering (General). Civil engineering (General)
Technology
Electrical engineering. Electronics. Nuclear engineering
Descriptive and experimental mechanics
physics
electronic computers. computer science
heat
|
Citations
No citations found. To add a citation, contact the admin at info@scimatic.org
Comments
No comments yet. Be the first to comment on this article.