Definition
High Performance Computing (HPC) refers to the practice of employing advanced computing techniques, typically utilising parallel processing and supercomputers, to solve complex problems that require significant computational power and data storage capabilities. As with other types of computing, HPC access can be organised through an on-premises model, a shared data centre or via cloud services where leading public cloud and specialist providers are emerging.
Please note, Mainframe has been separated out as a distinct capability.
Purpose
HPC is used to execute computational tasks at extremely high speeds, often involving massive datasets or complex simulations. HPC facilities are used across various fields including scientific research, engineering, weather forecasting, financial modelling, and artificial intelligence, among others, to accelerate the pace of discovery, innovation, and problem-solving.
HPC capability is essential for supporting and improving Australia’s AI capability.
HPC capability is realised through:
- identification of suitable use cases requiring HPC facilities
- design of solution architecture in line with organisational needs, enterprise architecture, ICT strategy and regulatory / policy constraints and guidelines
- assessment of options to realise the solution architecture design, including HPC cloud offerings and shared access to existing Australian Government HPC capacity
- procurement practice in line with Australian Government regulations, including use of procurement mechanisms operated by the DTA
- management of risks associated with HPC use, particularly ensuring investments are designed for re-use across the Australian Government and represent the best value for money for supporting organisational needs.
Objective
The objectives of this content are to:
- provide guidance on appropriate usage scenarios for this type of computing resource
- assist Commonwealth entities to identify re-use and sharing opportunities (including of resources and knowledge) across government
- ensure value for money, fitness-for-purpose, minimisation of risk, and the maximising of opportunities to utilise HPC for the benefit of the Australian Government and the nation.
Whole-of-government applicability
HPC resources, whether on-premises or via data centre / cloud services are expensive compared with regular, commoditised computing resources. Heightened demand is anticipated for access to HPC resources, with computationally-intensive and data-intensive workloads increasing across many portfolios, driven by:
- growing volumes of data held by Commonwealth entities
- increased awareness of the potential value to the nation in utilising this data
- trends in Artificial Intelligence (AI) exploration and adoption.
This aligns with the Data and Digital Government Strategy (DDGS), which sets a vision for 2030 to deliver simple, secure and connected public services for all people and business, through world class data and digital capabilities.
Suitable utilisation of HPC facilities supports the DDGS missions of:
- Delivering for all people and business: To maximise value from data, harnessing analytical tools and techniques (including machine learning and artificial intelligence) to predict service needs, improve user experience, support evidence-based decisions and gain efficiencies in agency operations.
- Government for the future: To safely adopt emerging technologies, including HPC, as outlined in the List of Critical Technologies in the National Interest, in order to realise their potential benefits.
Policy Elements
-
Identify needs and approach in advance of selecting HPC facilities
Plan and design systems which require HPC facilities using a coherent Enterprise Architecture approach, clearly setting out at both the solution architecture level and the broader enterprise architecture level how use of HPC meets business needs while representing the most cost-effective, fit-for-purpose, and risk-balanced solution approach.
-
Access HPC resources utilising shared facilities available to the APS
Prioritise the utilisation of Australian Government owned and operated facilities, Australian Government funded research facilities, and Australian Whole-of-Government procurement contract arrangements and other appropriate procurement arrangements with industry. Value for money in facilities should be balanced with additional factors as set out in the Standard.
-
Align to guidelines and standards
All Commonwealth entities must comply with the Hosting Certification Framework to ensure cloud-oriented HPC services are hosted in certified tenancies/data centres, as well as any other mandatory frameworks, policies, and standards.
-
Adhere to reuse principles
Entities must give priority to the utilisation of suitable existing HPC facilities and, where necessary, design new solutions with a focus on future reuse.