Definition
High Performance Computing (HPC) refers to the practice of employing advanced computing techniques, typically utilising parallel processing and supercomputers, to solve complex problems that require significant computational power and data storage capabilities. As with other types of computing, HPC access can be organised through an on-premises model, a shared data centre or via cloud services where leading public cloud and specialist providers are emerging.
Please note, Mainframe has been separated out as a distinct capability.
Purpose
HPC is used to execute computational tasks at extremely high speeds, often involving massive datasets or complex simulations. HPC facilities are used across various fields including scientific research, engineering, weather forecasting, financial modelling, and artificial intelligence, among others, to accelerate the pace of discovery, innovation, and problem-solving.
HPC capability is essential for supporting and improving Australia’s AI capability.
HPC capability is realised through:
- identification of suitable use cases requiring HPC facilities
- design of solution architecture in line with organisational needs, enterprise architecture, ICT strategy and regulatory / policy constraints and guidelines
- assessment of options to realise the solution architecture design, including HPC cloud offerings and shared access to existing Australian Government HPC capacity
- procurement practice in line with Australian Government regulations, including use of procurement mechanisms operated by the DTA
- management of risks associated with HPC use, particularly ensuring investments are designed for re-use across the Australian Government and represent the best value for money for supporting organisational needs.
Objective
The objectives of this content are to:
- provide guidance on appropriate usage scenarios for this type of computing resource
- assist Commonwealth entities to identify re-use and sharing opportunities (including of resources and knowledge) across government
- ensure value for money, fitness-for-purpose, minimisation of risk, and the maximising of opportunities to utilise HPC for the benefit of the Australian Government and the nation.
Whole-of-government applicability
HPC resources, whether on-premises or via data centre / cloud services are expensive compared with regular, commoditised computing resources. Heightened demand is anticipated for access to HPC resources, with computationally-intensive and data-intensive workloads increasing across many portfolios, driven by:
- growing volumes of data held by Commonwealth entities
- increased awareness of the potential value to the nation in utilising this data
- trends in Artificial Intelligence (AI) exploration and adoption.
This aligns with the Data and digital government strategy, which sets a vision for 2030 to deliver simple, secure and connected public services for all people and business, through world class data and digital capabilities.
Suitable utilisation of HPC facilities supports the Strategy's missions of:
- Delivering for all people and business: To maximise value from data, harnessing analytical tools and techniques (including machine learning and artificial intelligence) to predict service needs, improve user experience, support evidence-based decisions and gain efficiencies in agency operations.
- Government for the future: To safely adopt emerging technologies, including HPC, as outlined in the List of critical technologies in the national interest, in order to realise their potential benefits.