LUMI ranked third on Top500 list
EuroHPC Joint Undertaking’s LUMI supercomputer reached the third spot on the latest Top500 list of world’s fastest supercomputers released at the ISC22 conference in Hamburg, Germany on 30 May 2022. LUMI reached a measured High-Performance Linpack (HPL) performance of 151.9 petaflops. This makes LUMI the fastest supercomputer in Europe. The No. 1 spot in the Top500 list is now held by the Frontier system at Oak Ridge National Laboratory in the US.
In addition, LUMI supercomputer reached the third spot on the new Green500 list which ranks supercomputers from the Top500 list in terms of energy efficiency. The GFlops/Watts ratio for LUMI is 51.6, making it one of the greenest supercomputers in the world.
LUMI is a unique endeavour thanks to its scale, sustainability and pan-European nature, hosted by a consortium of ten countries, including Estonia.
Read more about the latest Top500 list: https://top500.org/lists/top500/2022/06/
Workshop "Programming on accelerators"
The Coordination and Support Action CASTIEL invites you to the online workshop “Programming on accelerators” which will take place on the 23rd May, 9:30 – 13:00 (CET).
The covered topics include introduction to GPU programming, performance optimization as well as multi-GPU and multi-stream programming.
Find out more and register: https://sway.office.com/uN7yUmeaMD9z7GdD
The CSC Summer School in High-Performance Computing
CSC Summer School brings together undergraduate and graduate students and postdoctoral researchers in different disciplines of scientific computing from all over the world. The contents consist of lectures and hands-on training on parallel programming, code optimization and other necessary skills in development of scientific software.
The school is aimed for graduate students working in various fields of science, e.g., chemistry, physics, life sciences, engineering or economics as well as Industrial R&D professionals. Also undergraduates as well as post-docs will find the school very useful.
The ten days of school are filled with coding, sports, leisure activities and having good time together. It will be an experience you will never forget with the midnight sun in the Nordic night next to breathtaking wilderness!
ESTONIA-GEORGIA JOINT TEAM TO WIN THIRD PLACE IN LOCKED SHIELDS 2022
More than 2000 participants were involved in cyber defence exercise Locked Shields 2022 that took place from April 19 to 22. This year, one of the venues of the event was the Delta Centre in Tartu. Employees of the HPC Center of the University of Tartu and the Institute of Computer Science participated in the Estonian team.
Locked Shields is known as the largest and most complex international cyber defence exercise in the world. It is organised by the NATO Cooperative Cyber Defence Centre of Excellence (CCDCOE) in cooperation with other partners annually since 2010. Locked Shields offers cyber experts a cutting-edge challenge to practice their skills in protection of civilian and military IT systems as well as critical infrastructure.
Locked Shields is a Red Team vs. Blue Team exercise with teams formed by member states and partners of the CCDCOE. According to the scenario, a fictional island country Berylia faces a large-scale cyber attack with its neighbour and rival country Crimsonia supposedly behind it. These attacks have caused severe disruptions to the operation of government and military networks, communications, water purification systems and electric power grid. The Blue Teams play the role of national rapid reaction teams that are deployed to assist Berylia in handling cyber incidents and their implications. The Red Team are the attackers who challenge the training audience by testing their ability to secure their systems under time and resource pressure.
Locked Shields follows the current geopolitical situation and draws a realistic vision of a contemporary world where cyber incidents are employed as part of a wider geopolitical strategy. Attacking is easier than defending as the attacker may just need access to one entry point while the defender must protect all the possibilities. This year, the multi-day exercise evolved around 5,500 virtualized systems that were subject to more than 8,000 live-fire attacks. To be successful, the teams must practice cooperation between both civilian and military units, as well as public and private sectors. The strategic decision-makers and technicians need to work together in securing complex IT systems, reporting incidents and solving various challenges. For the first time, this year’s exercise also included the simulation of reserve management and financial messaging systems of a central bank in the cyber range environment.
Locked Shields 2022 included 24 teams and more than 30 nations. Although the competition was very intense, the Finnish team outperformed others because of solid defence against network and web attacks and excellence in situation reporting. The joint team Lithuania-Poland came second, while the joint Estonia-Georgia team took a valuable third place.
Most contemporary conflicts involve a cyber dimension. The importance of Locked Shields lies in the fact that it provides participating nations a unique opportunity to test their skills in a safe environment while being aggressively challenged by a highly skilled adversary. Such collaborative exercises have become vital as cyber defence has been on high alert since the outbreak of the war in Ukraine. In addition, societies have become more dependent on virtual solutions during the global pandemic. This has greatly increased the attack surface for malicious actors and requires effective collaboration between public and private entities to ensure the systems we depend on can be protected.
Parallel Computing on GPUs with CUDA
The NCC Turkey would like to invite you to participate in the training entitled “Parallel Computing on GPUs with CUDA” (26-27 April 2022). The training language will be English.
– Introduction to Parallel Computing
– Introduction to GPUs and their Architecture
– CUDA Programming Model
– Using Multiple GPUs and Multiple Streams
– Debugging and Profiling Performance
– Performance Optimization and Efficiency
– Some Libraries and Remaining Issues
– CUDA Samples
Registration link: https://indico.truba.gov.tr/event/84/
Detailed introduction to the LUMI-C environment and architecture
This two day on-line course serves as a detailed introduction to the LUMI-C environment and architecture. Participants will also learn about porting, executing and optimising applications for the environment. The course will be jointly conducted by the LUMI HPE Centre of Excellence and the LUMI User Support Team. The course is intended for users with ongoing projects on LUMI-C and support staff of local organisations of the LUMI consortium members. Participation will be moderated due to the limited number of participants, but we encourage registrations. This will facilitate the planning of further training events.
There will be a waiting list if registrations exceed the number of planned participants. Registration deadline is April 22, 2022 16:00 CEST.
Read more and register: https://lumi-supercomputer.eu/events/detailed-introduction-to-lumi-c-april-2022/
A free online SYCL workshop
Take the opportunity to praticipate in the free SYCL workshop, organized by the EuroCC National Competence Centre Sweden.
SYCL is a C++ abstraction layer for programming heterogeneous hardware with a single-source approach. SYCL is high-level, cross-platform, and extends standard ISO C++17. There are numerous compilers implementing the SYCL standard and they use different backends to target CPUs, GPUs, and even specialized hardware such as field-programmable gate arrays (FPGA) and vector engines.
In this online workshop you will learn to:
- Use the hipSYCL compiler to generate executables for multiple hardware targets.
- Write hardware-agnostic code to express parallelism using the queue, command group, and kernel abstractions.
- Use buffer and accessors to handle memory across devices.
- Evaluate drawbacks and advantages of unified shared memory.
This workshop will be given by ENCCS expert Roberto Di Remigio Eikås, PhD. Supercomputer Karolina is going to provide computing resources for this workshop..
Time: April 19 @ 09:00 – April 21 @ 12:10 CEST
GTN Smörgåsbord 2 starts on March 14
GTN Smörgåsbord 2 is a free, global, week-long Galaxy training event showcasing a wide variety of Galaxy Training Network tutorials.
Galaxy, a scientific workflow system, aims to make computational biology accessible to research scientists that do not have computer programming or systems administration experience. Although it was initially developed for genomics research, it is largely domain agnostic and is now used as a general bioinformatics workflow management system.
The format of training event is virtual and asynchronous. All training session are pre-recorded and captioned, you can work through these at your own pace, with instructors available online for support.
When: March 14-18, 2022 (all time zones).
Who: Open for everybody
When: March 14-18, 2022 (all time zones).
Check out the schedule and register: https://gallantries.github.io/posts/2021/12/14/smorgasbord2-tapas/
Upcoming course: Introduction to artificial intelligence
This introductory course aims to introduce what is Artificial Intelligence in theory and in practice for those who have little or no prior contact with data science and programming.
The course is conducted fully online in the University of Tartu’s Moodle environment.
The course will takes place from March 14 to May 9, 2022 and is held in Estonian. Participation is free. The training is funded by the ESF through the ‘Promoting Adult Learning and Expanding Learning Opportunities’ program.
Registration is open until March 6, 2022.
Online course on Hybrid Programming in HPC – MPI+X
Most HPC systems are clusters of shared memory nodes. To use such systems efficiently both memory consumption and communication time has to be optimized. Therefore, hybrid programming may combine the distributed memory parallelization on the node interconnect (e.g., with MPI) with the shared memory parallelization inside of each node (e.g., with OpenMP or MPI-3.0 shared memory). This course analyzes the strengths and weaknesses of several parallel programming models on clusters of SMP nodes. Multi-socket-multi-core systems in highly parallel environments are given special consideration. MPI-3.0 has introduced a new shared memory programming interface, which can be combined with inter-node MPI communication. It can be used for direct neighbor accesses similar to OpenMP or for direct halo copies, and enables new hybrid programming models. These models are compared with various hybrid MPI+OpenMP approaches and pure MPI. Numerous case studies and micro-benchmarks demonstrate the performance-related aspects of hybrid programming.
This course is a PRACE training event. It is organized by the VSC Research Center, TU Wien, in cooperation with HLRS and NHR@FAU.
The course will take place on 5-7 April 2022. Read more and register here!
The EuroHPC Summit Week 2022
The EuroHPC Summit Week (EHPCSW) 2022 takes place in Paris on 22-24 March 2022. This event will gather the main European HPC stakeholders from technology suppliers and HPC infrastructures to scientific and industrial HPC users in Europe. As in previous years, PRACE, the Partnership for Advanced Computing in Europe, co-locates its Scientific and Industrial Conference (PRACEdays22) at the EuroHPC Summit Week 2022. Furthermore, the EHPCSW 2022 will provide a great opportunity for the attendees to network.
The main organisers of the EHPCSW 2022 are the Partnership for Advanced Computing in Europe (PRACE), and the European Technology Platform for High-Performance Computing (ETP4HPC). The EuroHPC Joint Undertaking (EuroHPC JU) and the European Commission are also involved in the organisation of the conference.
ESTONIAN-FINNISH JOINT WEBINAR "HIGH PERFORMANCE COMPUTING FOR SMES"
The NCC Estonia and the NCC Finland will organize a webinar for companies to demonstrate the added value that high performance computing can provide. Small and medium enterprises (SMEs) can hugely benefit from HPC systems as these technologies increase competitiveness while saving time and money.
The webinar will take place on March 3rd as an online event. Participation is free of charge.
Specialists of the University of Tartu’s HPC Center made LUMI supercomputer accessible to users
EuroHPC Call for Centres of Excellence in HPC
The European High Performance Computing Joint Undertaking (EuroHPC JU) is preparing the transition towards exascale with a new call on Centres of Excellence for HPC. Exascale supercomputers are capable of more than a billion billion operations per second.
The call is funded by Horizon Europe, the EU funding program for research and innovation with a total budget of up to EUR 90 million including up to EUR 45 million of EU contribution to be matched by equivalent national contributions. Applications are invited for two topics:
The call will be open for submissions from January 27, 2022 until April 6, 2022. The selected projects are expected to start by January 1, 2023 for a period of four years. Proposed applications will have to commit to co-design activities with regards to hardware, software and codes as this will be key in ensuring that future HPC architectures are well suited for the applications and their users. Coordination with the Competence Centres will be required in order to address the current HPC skills gap, develop available HPC competences and ensure wider access to exascale applications.
AIRE - the AI & Robotics Estonia technology hub - supports Estonian manufacturers
AIRE brings together Estonian manufacturing companies, solution providers, universities and science parks, with everyone striving for a single goal. AIRE works for industrial development and innovation in the whole of Estonia by offering manufacturing companies training, advice, and new, digital, tailor-made solutions that cannot be found on the open market.
AIRE offers companies the chance to use scientific and research laboratories and support big data management within High Performance Computing centres, thereby assisting to make Estonian manufacturing companies more competitive in foreign markets.
AIRE is led by Tallinn University of Technology, and its partners are the University of Tartu, the Estonian University of Life Sciences, Tehnopol Science and Business Park, Tartu Science Park, and the Innovative Manufacturing Engineering Systems Competence Centre IMECC. One important goal is to help companies find additional funding for applying artificial intelligence and robotics in their development projects, using funds from structural grants, the recovery fund, the Horizon programme, the Digital Europe Programme (DEP) and elsewhere.
NVIDIA offers free online training courses
Whether you’re an individual looking for self-paced, online training or an organization wanting to develop your workforce’s skills, the NVIDIA Deep Learning Institute (DLI) can help. Currently they offer five courses that are free for anybody to take self-paced.
Speed Up DataFrame Operations With cuDF demonstrates significant speed up by moving common DataFrame operations to the GPU with minimal changes to existing code.
Getting Started with Universal Scene Description for Collaborative 3D Workflows explains how to generate a scene using human-readable Universal Scene Description ASCII (.USDA) files.
LUMI’s full system architecture revealed
The AMD MI250X GPU is in a class of its own now and for a long time to come. The technical supremacy and performance per watt were the primary reasons why AMD’s MI250X GPUs were selected for LUMI, explains Pekka Manninen, Director of LUMI Leadership Computing Facility.
The full system architecture of LUMI is the following:
The LUMI system is supplied by Hewlett Packard Enterprise (HPE), based on an HPE Cray EX supercomputer.
The GPU partition will consist of 2560 nodes, each node with one 64 core AMD Trento CPU and four AMD MI250X GPUs.
Each GPU node features four 200 Gbit/s network interconnect cards, i.e. has 800 Gbit/s injection bandwidth.
Each MI250X GPU consists of two compute dies, each with 110 compute units each, and each compute unit has 64 stream processors for a total of 14080 stream processors.
The committed Linpack performance of LUMI-G is 375 Pflop/s.
The MI250X GPU comes with a total of 128 GB of HBM2e memory offering over 3.2 TB/s of memory bandwidth.
A single MI250X card is capable of delivering 42.2 TFLOP/s of performance in the HPL benchmarks.
In addition to the GPUs in LUMI there is another partition (LUMI-C) using CPU only nodes, featuring 64-core 3rd-generation AMD EPYC™ CPUs, and between 256 GB and 1024 GB of memory. There are 1,536 dual-socket CPU nodes in total. LUMI-C was #5 on the November 2021 Graph500 list and #76 on the November 2021 Top500 list.
LUMI also has a partition with large memory nodes, with a total of 32 TB of memory in the partition.
When completed LUMI will take over 150m2 of space, which is about the size of a tennis court. The weight of the system is nearly 150 000 kilograms (150 metric tons).
ETAIS & ELIXIR seminar UT HPC Usage 101
During this UT HPC Usage 101 lecture course we will provide the participants basic knowledge required to use to submit, monitor, and control jobs on the compute nodes of UT HPC. We will talk about the principles of computing in a cluster and the difference between computing directly from the command line of a private server. We will introduce the good practices and standards of behavior that good cluster usage practice requires. Also the convenient graphical tools for monitoring the resource of your work will be covered. Finally, we might touch on the basic Slurm commands.
We expect the users to have basic LINUX command line experience, but very little or no cluster compute experience yet.
Learning outcome: Knowing how to submit, monitor and control jobs at UT HPC.
The seminar will take place in Zoom on 18th of November 2021 at 14.00 and will last approximately 90 minutes.
Registration is open at https://forms.gle/pVe86HVqjWB6GpLg8 and will close on 16th of November or when the course gets full.
An OpenMP training organized by the LUMI User Support Team
The course will take place online on November 9. – 10.
This course is part of the first OpenMP training organized by the LUMI User Support Team (LUST) and supported by CSC – IT Center for Science Ltd (Finland) and CSC Autumn of HPC 2021 (five modules program on teaching essential skills in parallel programming for modern GPU-accelerated supercomputers) under PRACE Training Centres activity.
This training aims to help the users to port their code to LUMI, the European pre-exascale supercomputer, that will achieve its high computing power thanks to a large number of nodes with AMD GPUs.
This course address the use of OpenMP for programming co-processors such as GPUs. It focuses on how to get the best out of OpenMP in terms of performance by exploring the implications of possible OpenMP parallelization strategies. Advanced topics such as asynchronous execution, interoperability with CUDA/HIP and the use of multiple GPUs are covered.
Registration is obligatory since the details to access the online course will be provided to the registered and accepted attendees only.
Read more about the course and register now at the PRACE Training website.
ENCCS GPU Hackathon 2021
The EuroCC National Competence Centre Sweden (ENCCS) will be hosting an online NVIDIA GPU hackaton that will take place on December 6th and December 13-15.
GPU Hackathons provide exciting opportunities for scientists to accelerate their AI research or HPC codes under the guidance of expert mentors from National Labs, Universities and Industry leaders in a collaborative environment. Teams of researchers are paired with experienced GPU mentors to learn and apply the accelerated and parallel computing skills needed by the scientific community. Both current or prospective users of large hybrid CPU/GPU HPC clusters who develop HPC and AI applications that could benefit from GPU acceleration are encouraged to participate!
Teams are expected to bring their own code or project to the event and be motivated to make progress during the hackathon. No advanced GPU skills required, but teams are expected to know the basics of GPU programming and profiling at the event.
The application deadline is October 31, 2021. Please click here to find out more about the event.
A free course on Shared Memory Programming with OpenMP
The EuroCC-funded UK National Competence Centre offers an online OpenMP course that will be supported by staff from EuroCC and PRACE to answer questions via chatboards and run regular online tutorials. This course covers OpenMP, the industry standard for shared-memory programming, which enables serial programs to be parallelised easily using compiler directives. Users of desktop machines can use OpenMP on its own to improve program performance by running on multiple cores; users of parallel supercomputers can use OpenMP in conjunction with MPI to better exploit the shared-memory capabilities of the compute nodes.
The course starts on November 1 and ends on December 3. All participants will be offered an account on ARCHER2, the UK National HPC Service, for the duration of the course.
The course is part-funded by the PRACE project and is free to all. Please follow this link for more information and registration.
EuroHPC SUMMIT WEEK TO BE HELD IN PARIS, MARCH 22-24
The EuroHPC Summit Week (EHPCSW) 2022 will gather the main European HPC stakeholders from technology suppliers and HPC infrastructures to scientific and industrial HPC users in Europe. As in previous years, PRACE, the Partnership for Advanced Computing in Europe, co-locates its Scientific and Industrial Conference (PRACEdays22) at the EuroHPC Summit Week 2022. Furthermore, the EHPCSW 2022 will provide a great opportunity for the attendees to network.
The main organizers of the EHPCSW 2022 are the Partnership for Advanced Computing in Europe (PRACE), and the European Technology Platform for High-Performance Computing (ETP4HPC). The European Commission (EC) will represent the EuroHPC Joint Undertaking (EuroHPC) in the organization of the conference. The logistical organization is supported by a local host: for the 2022 edition, this will be GENCI (Grand equipement national de calcul intensif).
For more information visit this link and stay tuned for more details.
THE NCC ESTONIA IS CELEBRATING ITS FIRST BIRTHDAY
The HPC Competence Centre of Estonia was established within the scope of the EuroCC project exactly one year ago – on September 1, 2020. Our first year of operation has been full of intensive work, exciting challenges and interesting meetings. We have just completed our annual report, which summarizes the activities and achievements that have taken place during the last year. We are pleased to confirm that the activities of NCC Estonia have proceeded according to initial plan. Most of the key perfomance indicators are fulfilled or even exceeded.
We would also like to congratulate the CASTIEL team, as they are also celebrating its first year of operation. Some essential deliverables of the CASTIEL and EuroCC projects are now available for public.
FF4EuroHPC TO LAUNCH THE SECOND OPEN CALL FOR HPC EXPERIMENTS
FF4EuroHPC is a European initiative that helps facilitate access to HPC related technologies for SMEs. Within the FF4EuroHPC project, European SMEs can develop unique products, innovative business opportunities and become more competitive by using European high-end HPC services. Whether it is running high-resolution simulations, doing large-scale data analyses, or incorporating AI applications into SMEs´ workflows, FF4EuroHPC connects business with cutting-edge technologies.
Two open calls will be offered through the project. The second call for proposals targets highest quality experiments involving innovative, agile SMEs and putting forward work plans built around innovation targets arising from the use of advanced HPC services. Priority will be given to consortia centred on SMEs that are new to the use of advanced HPC services.
Key call details
Submission Deadline: 29th September 2021, at 17:00 Brussels local time.
Expected duration of experiments: maximum 15 months with expected commencement 1st March 2022.
Funding for Call-2: The indicative total funding budget is € 5 M.
Maximum funding request per proposal: € 200,000 (covering all participants).
Find out all the details about the open call and application process: https://www.ff4eurohpc.eu/en/open-calls/open-call/
WORKSHOP ON SARS-COV2 DATA ANALYSIS and monitoring WITH GALAXY
The goal of this upcoming workshop is to build capacity in SARS-CoV-2 data analysis and data management, including data submission to ENA. After the workshop, all participants will be able to upload viral sequencing data, call all variants, create a variety of reports and create consensus alignments.
It will be a 4-day event introducing scalable and reproducible SARS-CoV-2 data analysis with Galaxy. The sessions will be pre-recorded and provided in advance. During the workshop, there will be live support in chat and live Q&A sessions, in which experts will answer questions.
PRACE AUTUMN SCHOOL 2021:
HARNESSING the EuroHPC Flagship supercomputers
The PRACE Autumn School 2021 will bring together undergraduate and graduate students and postdoctoral researchers in different disciplines of scientific computing.
The course consists of lectures and hands-on training on modern, GPU-accelerated high-performance computing: GPU programming and GPU code optimization at scale, as well as understanding and applying machine learning methods. The course includes also scientific case studies about using GPUs in various disciplines. The tutors and lecturers are experts in these fields providing various interesting aspects in the course topics.
The five days of school, organised by CSC – IT Center for Science, are filled with hacking, leisure activities and having good time together in Vuokatti, Finland. Also, the Autumn School includes a visit to the CSC’s Data Center in Kajaani, the home of one of the most powerful supercomputers in the world: LUMI. It is a unique opportunity for the participants to familiarize themselves with the cutting-edge data infrastructure in the field of HPC.
Data Science Seminar:
High-Performance Computing: Big Is Beautiful
High-Performance Computing (HPC) is the application of “supercomputers” to computational problems that are either too large for standard computers or would take too long to solve. HPC is a pervasive tool for both academia and industry. “Today, to Out-Compute is to Out-Compete” best describes the role of HPC.
A recent seminar brought together HPC users, administrators and visionaries. Researchers talked about their experiences with using HPC in their daily work. The administrator of Tartu HPC center introduced the backstage of managing large amounts of data. Finally, we took a closer look at the new supercomputer LUMI, which will launch in 2021, to take computing performance to a new unprecedented level.
Galaxy-ELIXIR webinars series:
Galaxy is supported by a large and active community distributed across the globe, which leads to rapid developments in every release. However, many of this features remain unknown by most of the users.
With this series of four webinars chaired by Hans-Rudolf Hotz, the global Galaxy community will present such advanced features, touching upon workflows, data processing and management, interoperability and interactive tools, among others.
The webinar series takes place between 3 and 24 March 2021.
A new supercomputer LUMI starts operating in summer 2021
A new supercomputer LUMI (Large Unified Modern Infrastructure) is being built in Finland. It is expected to open for users from July 2021.
At the time of installation, LUMI will be one of the world’s fastest computer systems. LUMI’s performance will be more than tenfold compared to one of Europe’s fastest supercomputer today (Piz Daint, Switzerland). LUMI will also be one of the world’s leading platforms for artificial intelligence.
LUMI will be capable of executing 375 petaflops, or more than 375 million billion calculations per second. Theoretically, it’s maximum performance will be more than 550 petaflops per second, equalling that of 1.5 million laptops.
LUMI will be located at CSC’s (IT Center for Science) data center in Kajaani town. LUMI is using 100% hydropowered energy. The waste heat of LUMI will produce 20 percent of the district heat of the area.
The supercomputer will be hosted by the LUMI consortium including ten European countries: Finland, Belgium, the Czech Republic, Denmark, Estonia, Iceland, Norway, Poland, Sweden, and Switzerland.
As a member of the consortium, Estonia can use 2% of LUMI’s supercomputer resources. This opens up unprecedented technological opportunities for Estonian HPC users.
estonia has Joined the eurocc project
Estonia is participating in the EuroCC project, that brings together the necessary expertise to set up a network of more than 30 National Competence Centres (NCCs) in HPC across Europe.
The NCCs will coordinate activities in all HPC-related fields at the national level and serve as a contact point for customers from industry, science, HPC experts, and the general public alike.
The EuroCC project aims to elevate the participating countries to a common high level in the fields of HPC, High Performance Data Analytics (HPDA) and artificial intelligence. Ultimately, the goal is to promote the use of HPC in Europe and to increase the competences of its users.
The EuroCC activities are coordinated by the High-Performance Computing Center Stuttgart (HLRS). The EuroCC project is funded 50 percent through H2020 (EuroHPC Joint Undertaking) and 50 percent through national funding programs within the partner countries.