News


SKA to cooperate with CERN on big data

13 September 2017 News

The SKA Organisation and CERN, the European Laboratory for Particle Physics, have signed an agreement formalising their growing collaboration in the area of extreme-scale computing. The agreement establishes a framework for collaborative projects that addresses joint challenges in approaching Exascale (on the order of billions of Gigabytes) computing and data storage, and comes as the Large Hadron Collider (LHC) will generate even more data in the coming decade and SKA is preparing to collect a vast amount of scientific data as well.

Around the world, countries are engaged in efforts to cope with a leap in the demands of information and communication technology. The Square Kilometre Array (SKA) project, the world’s largest radio telescope when built, and CERN’s LHC, the world’s largest particle accelerator, famous for discovering the Higgs Boson, will contribute in driving the required technological developments.

Dr. Fabiola Gianotti, CERN director-general, and Prof. Philip Diamond, SKA director-general, signing a cooperation agreement between the two organisations on big data.
Dr. Fabiola Gianotti, CERN director-general, and Prof. Philip Diamond, SKA director-general, signing a cooperation agreement between the two organisations on big data.

“The signature of this collaboration agreement between two of the largest producers of science data on the planet shows that we are really entering a new era of science worldwide,” said Prof. Philip Diamond, SKA director-general. “Both CERN and SKA are and will be pushing the limits of what is possible technologically, and by working together and with industry, we are ensuring that we are ready to make the most of this upcoming data and computing surge.”

“The LHC computing demands are tackled by the Worldwide LHC computing grid which employs more than half a million computing cores around the globe interconnected by a powerful network,” elaborated Prof. Eckhard Elsen, CERN director of research and computing. “As our demands increase with the planned intensity upgrade of the LHC we want to expand this concept by using common ideas and infrastructure, into a scientific cloud. SKA will be an ideal partner in this endeavour.”

CERN and SKA have identified the acquisition, storage, management, distribution and analysis of scientific data as particularly burning topics to meet the technological challenges. In the case of the SKA, it is expected that phase 1 of the project – representing approximately 10% of the whole SKA – will generate around 300 PB (petabytes) of data products every year. This is 10 times more than today’s biggest science experiments.

CERN has just surpassed the 200 PB limit for raw data collected by the experiments at the LHC over the past seven years. A layered (tiered) system provides for data storage in the remote centres. The High-Luminosity LHC is estimated to exceed this level every year.

“This in itself will be a challenge for both CERN and SKA given the step change in the amounts of data we will have to handle in the next 5-10 years”, explains Miles Deegan, high-performance computing specialist for the SKA. “Transferring an average dataset will take days on the SKA’s ultra-fast fibre optic networks, which are 300 times faster than your average broadband connection, so storing or even downloading this data at home or even at your local university is clearly impractical.”

As is already the case at CERN, SKA data will also be analysed by scientific collaborations distributed across the planet. There will be common computational and storage resource needs by both institutions and their respective researchers, with a shared challenge of taking this volume of data and turning them into science that can be published, understood, explained, reproduced, preserved and presented.

“Processing such volumes of complex data to extract useful science is an exciting challenge that we face,” adds Antonio Chrysostomou, head of science operations planning for the SKA. “Our aim is to provide that processing capability through an alliance of regional centres located across the world in SKA member countries. Using cloud-based solutions, our scientific community will have access to the equivalent of today’s 35 biggest supercomputers to do the intensive processing needed to extract scientific results. In short, we need to fundamentally change how science is done.”

“CERN has proposed the concept of the Federated Open Science Cloud with other EIROForum members. This agreement is an important step in this direction,” said Ian Bird, responsible at CERN for the worldwide LHC computing grid. “Essentially, we will provide a giant cloud-based, Dropbox-like facility to science users around the world, where they will be able to not only access incredibly large files, but will also be able to do extremely intensive processing on those files to extract the science.”

For more information visit www.skatelescope.org





Share this article:
Share via emailShare via LinkedInPrint this page

Further reading:

From the editor's desk: Inspiring the next generation
Technews Publishing News
   Welcome to the August issue of Dataweek. Peter Howells is still on leave, so I am back for this issue. I hope you enjoy the content and find value in it. August is Women’s Month in South Africa, ...

Read more...
Procurement is becoming a competitive advantage
RS South Africa News
As mining, manufacturing and industrial businesses continue to navigate rising costs, supply chain disruption and increasing pressure to improve operational performance, procurement and inventory management have become strategic business priorities rather than simply administrative functions.

Read more...
Powell Electronics signs partnership agreement with IOT Electronics
IOT Electronics News
Powell Electronics has entered into a partnership agreement with IOT Electronics to strengthen its presence across southern Africa.

Read more...
Omniflex delivers ICCP systems across London
Omniflex Remote Monitoring Specialists News
Omniflex has supplied impressed current cathodic protection (ICCP) systems for a range of prominent buildings across London, helping to protect reinforced concrete structures from corrosion and extending their service life.

Read more...
New appointments for Würth Electronics South Africa
Würth Electronics South Africa News
New appointments for Würth Electronics South Africa

Read more...
MTN celebrates 80 Western Cape digital graduates
News
Eighty unemployed young people from across the Western Cape have successfully completed MTN South Africa’s Digital Skills for Digital Jobs (DS4DJ) programme, earning accredited qualifications in Data Analytics, Systems Development and Cybersecurity.

Read more...
GirlCode Hackathon 2026 kicks off across South Africa and Botswana
News
GirlCode, in partnership with Absa Group, Truecaller, MTN, SAP Fioneer, RS South Africa and other ecosystem partners, successfully hosted the first leg of the 2026 GirlCode Hackathon.

Read more...
Rooibos heads to space
News
A South African scientific initiative linking agriculture and space research has officially launched today with the Rooibos in Space programme at Parklands College’s Innovation Centre in Cape Town.

Read more...
From the editor's desk: Local can be international
Technews Publishing Editor's Choice News
Welcome to the July 2026 issue of Dataweek. As you can see from this introduction, Dataweek’s regular editor, Peter Howells, is on extended leave and I am filling the void in his editor’s column – hopefully without being too boring.

Read more...
Landis+Gyr EMEA introduces new company name: EYKON
News
EYKON is the new company name of Landis+Gyr EMEA, formerly part of the Landis+Gyr Group. The company supports electricity, gas, water and thermal utilities in managing increasingly complex networks, improving operational efficiency and enabling more sustainable use of resources.

Read more...









While every effort has been made to ensure the accuracy of the information contained herein, the publisher and its agents cannot be held responsible for any errors contained, or any loss incurred as a result. Articles published do not necessarily reflect the views of the publishers. The editor reserves the right to alter or cut copy. Articles submitted are deemed to have been cleared for publication. Advertisements and company contact details are published as provided by the advertiser. Technews Publishing (Pty) Ltd cannot be held responsible for the accuracy or veracity of supplied material.




© Technews Publishing (Pty) Ltd | All Rights Reserved