Main objective

The HPC federation Working Group (WG) aims to introduce a federated HPC service in the EGI infrastructure. This requires the establishment of policies and technical solutions on:

1. Federated user access management on HPC systems, in compliance with EOSC and other relevant initiatives
2. Availability and reliability monitoring of federated HPC sites
3. Integrated usage accounting across HPC, cloud and HTC sites
4. Access to distributed, federated data from HPC systems
5. Portable container-based applications for cloud compute, HTC and HPC systems
6. Resource brokering and allocation practices for international use cases

Activities

To support this goal, the WG builds on the existing work from EGI-ACE (HPC Integration handbook), C-SCALE and interTwin projects to carry out the following  activities: 

• Perform technology scouting to identify available technical solutions to integrate HPC with Cloud and HTC for enabling the execution of user workloads on top of heterogeneous resources;
• Liaise with user communities to gather requirements and representative use cases;
• Identify gaps of the current solutions with a focus on those from the technology providers participating in the WG;
• Discuss and plan enhancements for technical providers.
• Define and establish an HPC service in the EGI Service Portfolio for Research

HPC WG Composition

EGI is engaging different types of stakeholders to accomplish the objectives of this WG:

• Infrastructure providers with HPC capabilities: to pilot, deploy and validate the solutions from the WG, and to serve the core providers in the future EGI HPC service
• User communities: to present representative use cases and related requirements; to test and validate solutions;
• Technical providers: to supply technological bulding blocks;

Duration and outcome

The WG has a duration of one year, starting from June 2024 and its main activity is to produce a blueprint for the definition of a new EGI HPC service supported by the Federation members.

Meetings

14 Jun 2024 Kick-off meeting 

16 Jul 2024 Meeting #2

20 Sep 2024 Meeting #3

Documents and resources

All Documents