Australian Government Architecture
Search

High Performance Computing

Definition

High Performance Computing (HPC) refers to the practice of employing advanced computing techniques, typically utilising parallel processing and supercomputers, to solve complex problems that require significant computational power and data storage capabilities. As with other types of computing, HPC access can be organised through an on-premises model, a shared data centre or via cloud services where leading public cloud and specialist providers are emerging.

Please note, Mainframe has been separated out as a distinct capability.

Purpose

HPC is used to execute computational tasks at extremely high speeds, often involving massive datasets or complex simulations. HPC facilities are used across various fields including scientific research, engineering, weather forecasting, financial modelling, and artificial intelligence, among others, to accelerate the pace of discovery, innovation, and problem-solving. 

HPC capability is essential for supporting and improving Australia’s AI capability.

HPC capability is realised through:

  • identification of suitable use cases requiring HPC facilities
  • design of solution architecture in line with organisational needs, enterprise architecture, ICT strategy and regulatory / policy constraints and guidelines
  • assessment of options to realise the solution architecture design, including HPC cloud offerings and shared access to existing Australian Government HPC capacity 
  • procurement practice in line with Australian Government regulations, including use of procurement mechanisms operated by the DTA
  • management of risks associated with HPC use, particularly ensuring investments are designed for re-use across the Australian Government and represent the best value for money for supporting organisational needs.

Objective

The objectives of this content are to:

  • provide guidance on appropriate usage scenarios for this type of computing resource
  • assist Commonwealth entities to identify re-use and sharing opportunities (including of resources and knowledge) across government
  • ensure value for money, fitness-for-purpose, minimisation of risk, and the maximising of opportunities to utilise HPC for the benefit of the Australian Government and the nation.

Whole-of-government applicability

HPC resources, whether on-premises or via data centre / cloud services are expensive compared with regular, commoditised computing resources. Heightened demand is anticipated for access to HPC resources, with computationally-intensive and data-intensive workloads increasing across many portfolios, driven by:

  • growing volumes of data held by Commonwealth entities
  • increased awareness of the potential value to the nation in utilising this data
  • trends in Artificial Intelligence (AI) exploration and adoption.

This aligns with the Data and Digital Government Strategy (DDGS), which sets a vision for 2030 to deliver simple, secure and connected public services for all people and business, through world class data and digital capabilities.

Suitable utilisation of HPC facilities supports the DDGS missions of:

  • Delivering for all people and business: To maximise value from data, harnessing analytical tools and techniques (including machine learning and artificial intelligence) to predict service needs, improve user experience, support evidence-based decisions and gain efficiencies in agency operations.
  • Government for the future: To safely adopt emerging technologies, including HPC, as outlined in the List of Critical Technologies in the National Interest, in order to realise their potential benefits.

Policy Elements

Policy:
POL46
High Performance Computing policy Mandate:
Endorsed
Status:
Core
  • Identify needs and approach in advance of selecting HPC facilities

    Plan and design systems which require HPC facilities using a coherent Enterprise Architecture approach, clearly setting out at both the solution architecture level and the broader enterprise architecture level how use of HPC meets business needs while representing the most cost-effective, fit-for-purpose, and risk-balanced solution approach.

  • Access HPC resources utilising shared facilities available to the APS

    Prioritise the utilisation of Australian Government owned and operated facilities, Australian Government funded research facilities, and Australian Whole-of-Government procurement contract arrangements and other appropriate procurement arrangements with industry. Value for money in facilities should be balanced with additional factors as set out in the Standard.

  • Align to guidelines and standards

    All Commonwealth entities must comply with the Hosting Certification Framework to ensure cloud-oriented HPC services are hosted in certified tenancies/data centres, as well as any other mandatory frameworks, policies, and standards.

  • Adhere to reuse principles

    Entities must give priority to the utilisation of suitable existing HPC facilities and, where necessary, design new solutions with a focus on future reuse.

Domains

This capability is part of the following domain.
DOM2

Technology Reference

Policies

The following policies have requirements that impact this capability.
Mandate: Endorsed
Status: Core
This policy describes the requirements for entities planning digital investments involving High Performance Computing. Applicability Digital investment proposals are assessed against this policy by the DTA through the Digital and ICT Investment Oversight Framework (IOF). Commonwealth entities are…

Standards

The following standards support development of digital solutions in this capability.
High Performance Computing (HPC), as a category of computing, is becoming strategically important to Australia’s future as workloads such as AI Large Language Model training, earth observation, weather and climate modelling, and other massively parallel processing workloads with very large datasets…

Designs

The following designs include examples of how digital solutions in this capability can be delivered.

Lead Agency: Bureau of Meteorology

The Bureau of Meteorology has a custom HPC facility designed for weather prediction and climate research. The facility uses powerful supercomputers such as Cray XC40 (Australis) and Cray XC50 (Australis II), which provide significant computational power. It is suited to bespoke, batch workloads…

Strategic Alignment

Digital solutions in this capability can support the following strategies.

Whole of Government Hosting Strategy: Hosting Certification Framework

List of critical technologies in the national interest

Was this information helpful?

Do not include any personal information. We are unable to respond to comments or feedback. If you would like a response, please email, or phone us. Our details are on the AGA contact page www.architecture.digital.gov.au/contact-us.