As published in HPCWir
The recent 2024 EuroHPC Summit meeting took place in Antwerp, with attendance substantially up since 2023 to 750 participants. HPCwire asked Intersect360 Research senior analyst Steve Conway, who closely tracks HPC, AI, and related developments in Europe and attended the event, to interview Anders Dam Jensen, Executive Director of the EuroHPC Joint Undertaking, on the latest activities at the JU (EuroHPC Joint Undertaking).
Steve Conway: Since I began working on studies for the Commission in 2010, Europe has advanced strongly in HPC to become one of the global leaders, not just in funding and deploying leadership-class supercomputers such as LUMI and others, but increasingly also in producing technologies used in the supercomputers. How did this major progress happen?
Anders Jensen: HPC has been identified by European policymakers as a game-changing technology, enabling groundbreaking research and innovation across various scientific disciplines. As the performance of HPC technologies has improved, their use has drastically increased in many scientific areas, and therefore, their strategic potential has also increased. HPC is now recognized as a powerful tool that is essential to pushing back the boundaries of science and as a highly strategic resource that is critical in guaranteeing Europe’s digital sovereignty.
Consequently, the European Union established the European High-Performance Computing Joint Undertaking (EuroHPC JU) in 2018. As a legal and financial entity with a formidable allocated budget of around 7 billion euros for the period 2021-2027, provided by the European Union and national contributions. The EuroHPC JU has since been able to procure its own infrastructure and invest sustainably in developing a full European supercomputing ecosystem. Thanks to substantial financial resources and appropriate legal frameworks, the JU started to invest in a complete, ‘made in Europe’ supercomputing supply chain, from the processors, hardware, and software to applications to be run on these supercomputers and know-how to develop a strong European expertise.
Steve Conway: What’s been the impact of these investments?
Anders Jensen: The creation of the JU has undoubtedly been a major turning point in the European HPC strategy. Now, we can observe the effects of such an ambitious strategy. Europe is now officially considered a world leader in the field, with three EuroHPC supercomputers ranked among the world’s top 10 most powerful supercomputers. In parallel, the JU has significantly invested in a whole European stack of technologies: creating European CPUs for future systems with projects like the European Processor Initiative, developing European interconnect technologies, and developing software systems and applications. It is incredibly rewarding to see the strong and ambitious European political vision becoming a reality.
HPCWire: Speaking of producing HPC technology, where does the goal of HPC sovereignty stand today?
Steve Conway: As I just highlighted, the primary raison d’être of the EuroHPC JU is to increase the digital autonomy and sovereignty of the European Union. Building a European sovereign supercomputing ecosystem is critical to ensure that research and science can remain and be done in Europe and, most importantly, to bolster Europe’s competitiveness and resilience toward foreign technologies and imports.
HPCwire: HPC sovereignty is a major goal, but I assume it will take some time to achieve fully.
Steve Conway: HPC sovereignty remains more than ever a topical issue for all, not just Europe. As an example, I would point to what is happening in the chips race and how technology companies are currently hunting for alternative sources to GPUs that are needed for AI.
A strategy like this cannot be delivered overnight, and in Europe we are still dependent on foreign technologies, especially for processors. But a paradigm shift is taking place. JUPITER’s general-purpose cluster module will rely on the first generation of the SiPearl Rhea1 processor, a European-developed technology supported by the EuroHPC JU. And that’s not all: our first exascale system will also rely on software stacks allied with European-developed technologies developed by the Julich Supercomputing Center within the framework of the DEEP projects that are funded by the EuroHPC JU. In a nutshell, HPC sovereignty remains paramount for Europe, and it’s not going to be completed anytime soon, but the first tangible achievements are now at hand.
Steve Conway: Historically, there has been a large divide between HPC capabilities in the so-called Big 6 national economies and the other EU member states. Can you talk about how the JU and the member states have been collaborating to address this with the consortium idea and initiatives such as EuroCC and CASTIEL?
Anders Jensen: Indeed, some European countries have been working at the forefront of HPC since the start of the supercomputer era and have developed important HPC capabilities, while others may not have fully developed their HPC capabilities due to factors such as limited resources, national priorities, differing research focuses or investment patterns. One of the JU’s objectives is to even out the fact that European countries are at very different levels of HPC expertise and experience, which can impact their ability to engage in this field.
One of the founding principles of our JU is to pool together the resources of many countries to offer every participating country more opportunities than they would otherwise have. This goal means, for instance, that all European users can benefit from our supercomputers, no matter where they are located in Europe. It also means that smaller countries can purchase and own HPC systems. In our ecosystem, a certain number of world-class systems, especially the petascale and mid-range ones, are procured, co-owned, and managed by smaller countries. Smaller countries with less HPC background can also collaborate with other countries in consortia to host our biggest systems. The example of LUMI is, for instance, very enlightening, with 11 European countries being part of this true European success story!
Steve Conway: What about EuroCC and CASTIEL?
Anders Jensen: In parallel, we have strategic initiatives like EuroCC and its Coordination and Support Action (CSA) CASTIEL that are addressing the expertise gap in the European HPC ecosystem and coordinating cooperation across Europe to ensure a consistent skills base. EuroCC has built a European network of more than 30 HPC competence centers across Europe. The EuroCC’s competence centers act as hubs to promote and facilitate HPC and related technologies across a range of users from academia, industry – especially SMEs (Small and Medium-sized Enterprises) – and public administration. The aim is to increase access to HPC opportunities and offer tailored solutions adapted to the local environment and in national languages, both in the highly experienced and less experienced countries at HPC. And we have just launched a call that will further increase the number of countries participating in this network.
Steve Conway: Another important goal is sustainability, especially as the HPC community begins thinking about the next major milestone, zettascale computing. Does the JU have specific goals? Are they related to Europe’s decarbonization targets for 2030 and 2050?
Anders Jensen: Since the EuroHPC JU’s inception and in line with the EU’s ambitious plans to achieve carbon neutrality by 2050, sustainability is enshrined in our founding regulation and has been a cornerstone of our action. I would go even further and say that it is perhaps our trademark in the community because speed of calculation isn’t everything!
Our commitment is to build supercomputers that are big on capability and speed and low on environmental impact, drawing on technologies such as water cooling, waste heat recycling, dynamic power-saving, and next-generation energy-efficient microprocessors. All EuroHPC JU supercomputers are, for instance, water-cooled, removing the requirement of high operational costs of air-cooled systems and, in parallel, reducing the energy footprint of our systems.
Steve Conway: How large a role does sustainability play in EuroHPC JU procurements?
Anders Jensen: Sustainability is taken into consideration not only when we design our procurements but also when we select entities that will host our supercomputers. It also makes financial sense, as it can help to bring the costs of electricity down. Much care has, for instance, been taken to ensure that these extremely powerful machines can operate in the most sustainable way possible. LUMI is fully powered using renewable energy. It uses natural cooling systems to cool down its processors, and all the waste heat it produces is reused for local district heating in the city of Kajaani, Finland. The same applies to MareNostrum 5, which will be fully powered with sustainable energy and whose waste heat will be recycled to heat the building where it is located in Barcelona. Another good example is MeluXina in Luxembourg, which is entirely powered by green energy from a cogeneration plant powered by waste wood.
In addition, the EuroHPC JU is also helping to redesign supercomputers from the inside out. To do so, we are, for instance, investing in the development of next-generation microprocessors that will rely on energy-efficient architectures such as the Rhea1 processor, which, as I mentioned, will power JUPITER.
It’s gratifying to see these efforts being rewarded, with all our operational systems ranked among the greenest worldwide, with special mentions for MareNostrum 5, the sixth-greenest supercomputer in the world, just ahead of LUMI, seventh worldwide.
Steve Conway: The Fortissimo initiative morphed into other programs aimed at providing HPC access and support to SMEs in Europe. Where does support for SMEs stand today, and why is it important?
Anders Jensen: Supporting European SMEs remains a strategic priority for us, as they account for 99% of all European businesses, forming the backbone of our economy and representing a huge pool of potential HPC users! Stimulating the HPC innovation potential of SMEs is essential to position SMEs as technology leaders, fuel their success, and contribute to accelerating innovation and driving Europe’s economy. Supporting and educating SMEs on how to access and exploit HPC resources is also a way to expand the HPC user base and attract new users of HPC in different application domains.
Steve Conway: HPC has increasingly been moving beyond science, engineering, and other established domains to support research in the liberal arts and other areas. Is that also happening in the JU?
Anders Jensen: Widening the use of HPC is part of the EuroHPC JU mission. Just a few weeks ago, the EuroHPC JU collaborated with the EuroCC network to organize an event focused on the fields of social sciences and humanities and how they can exploit HPC capabilities. This field has witnessed a profound shift towards computational methodologies in recent years. From analyzing large datasets to modeling human behavior or studying social patterns and population movements, the use of HPC has become increasingly indispensable in addressing the multifaceted challenges faced by researchers in these domains. Our role is to reach and support these non-traditional HPC users who are nevertheless curious about harnessing the power of HPC. In another vein, I really enjoyed the presentation of Holger Weiss, CEO of M.A.R.K.13 GROUP, at the EuroHPC Summit 2024, in which he explained how HPC was helping his animation studio to create high-end images for animated movies. The fact that HPC can also be a cultural enabler is a very refreshing perspective for our community.
The new development is that HPC and associated technologies, such as High-Performance Data Analytics (HPDA) and AI, are increasingly becoming general-purpose, widely deployed tools for both academia and large industrial organizations. There is still work to be done, however, to ensure widespread uptake of these novel technologies by SMEs. There are a few reasons for this, such as SMEs not having the relevant HPC expertise and often lacking the necessary computational resources. Additionally, SMEs are all facing the same essential challenge: the high risk of potential failure linked to a necessary high investment for testing these new technologies.
Steve Conway: That brings me back to the question about a successor for Fortissimo.
Anders Jensen: Following the success of the Fortissimo initiative and, more recently, FF4EuroHPC, I am very happy to announce that the successor of these initiatives, Fortissimo Plus (FFplus), is about to start for a four-year duration with funding from the EuroHPC JU. The consortium behind the project will consist of known partners already involved in the previous initiatives and a new beneficiary. The main objective remains unchanged: to support the uptake of HPC by SMEs by offering them the right knowledge and financial and technical support. The novelty of FFplus will be a special focus on adoption of HPC by SMEs working on large AI models, such as large language models.
Steve Conway: The HPC and much larger AI markets have been converging. HPC has contributed key things to the AI market, such as 40 years of experience with parallelism and MPI communications. On the other hand, 11 large hyperscale companies control the global market for GPUs that the HPC community also needs. How do you see the HPC and mainstream AI communities co-existing?
Anders Jensen: It is clear that AI is disrupting the traditional HPC ecosystem. AI applications have different requirements in terms of architectures, access policies, and runtime environments. For example, AI seems to be struggling with multi-tenancy and bare metal access to supercomputers which is very different from the way traditional HPC communities have been using them.
Traditional HPC communities have adapted their tools, workflows and mindset in exploiting HPC resources in a direct manner, i.e., without relying on any virtualization or containerised solutions. AI users, on the contrary, are more accustomed to cloud computing environments which offer a sense of isolation and dedication of resources to specific users. The small but notable loss of performance coming from the virtualization layers does not bother AI users, who usually put more emphasis on usability than squeezing 100% out of the underlying hardware capabilities.
Therefore, initiatives to train the AI community on how to optimally use supercomputing infrastructures might be very relevant and beneficial for all. Additionally, traditional supercomputing centers also need to adapt their modus operandi by providing tools and policies that better match the needs of AI users.
Steve Conway: Is the JU involved in promoting responsible AI? In our early AI era, we’re using learning models that aren’t transparent and trustworthy, along with generative AI that can’t tell fact from fiction. That can lead to errors and bias if AI isn’t used appropriately.
Anders Jensen: Used correctly and combined with HPC, AI technology is certainly a powerful tool which can contribute to a more innovative, sustainable, and competitive economy, while also improving safety, education, and healthcare for citizens. It is a brand new process for us, but indeed, since last month, the EuroHPC JU is very much involved in promoting responsible AI.
At the beginning of March, we launched a new type of access call specifically to support ethical artificial intelligence, machine learning, and data-intensive applications in general, with a particular focus on foundation models and generative AI. The call is designed to serve industry organizations, SMEs, startups, and public sector entities requiring access to supercomputing resources to perform artificial intelligence and data-intensive activities. When submitting their proposals, the applicants are asked to provide ethical self-assessments, which are then carefully reviewed by the EuroHPC JU’s access resource committee. This is, for us, a first step in promoting responsible and trustworthy AI and ensuring the technology is used in the most appropriate manner. This is a brand-new aspect of our activities, and I am sure that we will continue to improve our processes for assessing responsible AI as we gain more experience.
Steve Conway: I assume the JU’s responsible AI initiatives are aligned with European Commission goals?
Anders Jensen: Yes, we are part of a bigger strategy at the European level. In January 2024, the European Commission launched its AI innovation package to support European startups and SMEs in the development of trustworthy AI that respects EU values and rules. As part of this new proposal, there is an ongoing legislative process to extend the mission of the EuroHPC JU and include the deployment of an AI supercomputing infrastructure to support Europe’s AI startups and researchers. Once the legislative process is completed, our regulation will provide us with more clarity and the means to best tackle such a new and ambitious task.
Steve Conway: What’s next for the JU? I believe the next funding cycle isn’t far away.
Anders Jensen: As always, many things are in preparation at the JU, and I could spend hours telling you about what is coming up next for the JU. I will do my best to stay concise. On top of what we already discussed, we are about to finalize a number of quantum computer procurements to be deployed across Europe. In parallel, our call to set up European Quantum Excellence Centers is currently open and will close in mid-May. Our ambition is to offer the widest possible variety of different European quantum computing platforms and hybrid classical-quantum architectures, giving Europe the opportunity to be at the forefront of this emerging field and to provide European users with access to diverse and complementary quantum technologies.
By the end of the month, our call to select entities to host our first industrial-grade supercomputers will close, and the coming months will be dedicated to evaluating the received proposals and preparing the hosting agreements. By adding these supercomputers specifically tailored to the needs of industrial users to the EuroHPC fleet, we will address the growing demand from industries for computing resources. This EuroHPC industrial-grade infrastructure will be instrumental in further boosting the innovation potential of enterprises in Europe.
Skills and competencies are always high on our list of priorities. As well as EUMaster4HPC, our pan-European Masters’ program to train the next generation of European supercomputing experts, we recently launched HPC Spectra, a new project focusing on skills. This project aims to improve the EuroHPC JU’s training strategy by developing an innovative EuroHPC Training Platform and co-organizing the 2024 and 2025 International HPC Summer Schools. More projects supporting the development of skills in Europe are also in the pipeline. As rightly highlighted by RafałDuczmal, the chair of the EuroHPC JU Governing Board, at the opening plenary of the EuroHPC Summit 2024, “talented and well-educated people are the greatest European asset,” and the EuroHPC’s job is to preserve, protect and empower this most precious resource.
Our current budget of 7 billion euros will take us up to 2027. From my perspective, we have just reached the halfway point of this funding cycle. However, the reality is that preparations for the next funding cycle are already well underway on the European Commission’s side. The EuroHPC JU is not involved in these strategic discussions, but I am nevertheless confident that HPC and quantum computing will remain high priorities for the European Union after 2027.
Steve Conway, senior analyst at Intersect360 Research, has closely tracked AI progress for more than a decade. Conway has spoken and published widely on this topic, including an AI primer for senior U.S. military leaders co-authored with Johns Hopkins University Applied Physics Laboratory.