News


SKA to cooperate with CERN on big data

13 September 2017 News

The SKA Organisation and CERN, the European Laboratory for Particle Physics, have signed an agreement formalising their growing collaboration in the area of extreme-scale computing. The agreement establishes a framework for collaborative projects that addresses joint challenges in approaching Exascale (on the order of billions of Gigabytes) computing and data storage, and comes as the Large Hadron Collider (LHC) will generate even more data in the coming decade and SKA is preparing to collect a vast amount of scientific data as well.

Around the world, countries are engaged in efforts to cope with a leap in the demands of information and communication technology. The Square Kilometre Array (SKA) project, the world’s largest radio telescope when built, and CERN’s LHC, the world’s largest particle accelerator, famous for discovering the Higgs Boson, will contribute in driving the required technological developments.

Dr. Fabiola Gianotti, CERN director-general, and Prof. Philip Diamond, SKA director-general, signing a cooperation agreement between the two organisations on big data.
Dr. Fabiola Gianotti, CERN director-general, and Prof. Philip Diamond, SKA director-general, signing a cooperation agreement between the two organisations on big data.

“The signature of this collaboration agreement between two of the largest producers of science data on the planet shows that we are really entering a new era of science worldwide,” said Prof. Philip Diamond, SKA director-general. “Both CERN and SKA are and will be pushing the limits of what is possible technologically, and by working together and with industry, we are ensuring that we are ready to make the most of this upcoming data and computing surge.”

“The LHC computing demands are tackled by the Worldwide LHC computing grid which employs more than half a million computing cores around the globe interconnected by a powerful network,” elaborated Prof. Eckhard Elsen, CERN director of research and computing. “As our demands increase with the planned intensity upgrade of the LHC we want to expand this concept by using common ideas and infrastructure, into a scientific cloud. SKA will be an ideal partner in this endeavour.”

CERN and SKA have identified the acquisition, storage, management, distribution and analysis of scientific data as particularly burning topics to meet the technological challenges. In the case of the SKA, it is expected that phase 1 of the project – representing approximately 10% of the whole SKA – will generate around 300 PB (petabytes) of data products every year. This is 10 times more than today’s biggest science experiments.

CERN has just surpassed the 200 PB limit for raw data collected by the experiments at the LHC over the past seven years. A layered (tiered) system provides for data storage in the remote centres. The High-Luminosity LHC is estimated to exceed this level every year.

“This in itself will be a challenge for both CERN and SKA given the step change in the amounts of data we will have to handle in the next 5-10 years”, explains Miles Deegan, high-performance computing specialist for the SKA. “Transferring an average dataset will take days on the SKA’s ultra-fast fibre optic networks, which are 300 times faster than your average broadband connection, so storing or even downloading this data at home or even at your local university is clearly impractical.”

As is already the case at CERN, SKA data will also be analysed by scientific collaborations distributed across the planet. There will be common computational and storage resource needs by both institutions and their respective researchers, with a shared challenge of taking this volume of data and turning them into science that can be published, understood, explained, reproduced, preserved and presented.

“Processing such volumes of complex data to extract useful science is an exciting challenge that we face,” adds Antonio Chrysostomou, head of science operations planning for the SKA. “Our aim is to provide that processing capability through an alliance of regional centres located across the world in SKA member countries. Using cloud-based solutions, our scientific community will have access to the equivalent of today’s 35 biggest supercomputers to do the intensive processing needed to extract scientific results. In short, we need to fundamentally change how science is done.”

“CERN has proposed the concept of the Federated Open Science Cloud with other EIROForum members. This agreement is an important step in this direction,” said Ian Bird, responsible at CERN for the worldwide LHC computing grid. “Essentially, we will provide a giant cloud-based, Dropbox-like facility to science users around the world, where they will be able to not only access incredibly large files, but will also be able to do extremely intensive processing on those files to extract the science.”

For more information visit www.skatelescope.org





Share this article:
Share via emailShare via LinkedInPrint this page

Further reading:

Revamped technical training centre in Welkom
News
Resolution Circle has announced the launch of its newly revamped training centre in Welkom, which will enhance technical education and foster industry partnerships.

Read more...
E-mobility: Navigate safety, interoperability and conformance
Concilium Technologies News
In this whitepaper, these challenges are discussed in more detail and the question is asked: How can EV and EVSE manufacturers navigate a complex regulatory landscape and deliver a quality product, without compromising time-to-market projections?

Read more...
Navigating South Africa’s transition from the NQF to OQSF framework
News
South Africa is at a crossroads of a significant educational and vocational transition, as it shifts from the National Qualifications Framework (NQF) to the Occupational Qualifications Sub Framework (OQSF) managed by the Quality Council for Trades and Occupations.

Read more...
Practical insights: Draft regulations on proposed sectoral targets
News
On 1 February 2024, the Minister of Employment and Labour issued new draft regulations concerning sectoral targets (draft regulations), providing a 90-day window for interested parties to comment.

Read more...
Top skills needed in microelectronics industry
News
The EU funded project MicroElectronics Training, Industry and Skills (METIS), which began in 2019, has officially concluded, and with this, SEMI Europe has published the final Yearly Monitoring Report.

Read more...
RS expands its professional lineup
RS South Africa News
RS PRO offers a wide range of high-quality electronics components, to meet a range of needs, from industrial connectors and passives to the latest test and measurement equipment.

Read more...
Alternative energy resource hub
News
Mouser Electronics is providing engineers with key information to solve today’s design challenges through its dedicated alternative energy resource centre.

Read more...
NECTO Studio 6.0 brings circuits to life
News
MIKROE has added increased graphical functionality and Clang support for ARM and RISC-V to its cross-platform IDE for embedded applications.

Read more...
Microchip earns certification in vehicle cybersecurity
Altron Arrow News
Microchip Technology’s corporate processes associated with specific automotive work products have recently been audited by a third party, UL Solutions, and certified as compliant to ISO/SAE 21434.

Read more...
From the editor's desk: A scourge on education
Technews Publishing News
The current government has done very little to curb the rampant affect that loadshedding has had on education in the last 10 years.

Read more...