Belnet and BrENIAC. High Performance Network for High Performance Computing. Jan Ooghe, Herman Moons KU Leuven BNC Oktober

Transcription

1 Belnet and BrENIAC High Performance Network for High Performance Computing Jan Ooghe, Herman Moons KU Leuven BNC Oktober

2 Supercomputing? A supercomputer is a computer that is considered, or was considered at the time of its introduction, to be at the frontline in terms of processing capacity, particularly speed of calculation. Abacus BC Flop/s No 1 Top 500 now Future? Sunway TaihuLight Quantum computing? Petaflop/s Exaflop/s? Photo: Abacus from Paul Schadler licensed under the Creative Commons Attribution 2.0 Generic license.

3 What a supercomputer is NOT

4 Actually, nowadays it is more like.

5 Do we really need supercomputing?

6 HPC use case: Regional climate studies Climate research is about uncovering all elements that influence the climate and discovering the way they interact. Computational modelling on HPC systems is a crucial part of this research. Nicole Van Lipzig, Regional Climate Studies

7 HPC use case: Astrophysics HPC enables us to predict the impact of the Sun on Earth with physics-based models, in time! S. Poedts, CmPA Evolution of solar wind and coronal mass ejections in the inner heliosphere

8 HPC use case: pesticide spray drift Based on these simulations official guidelines were formulated on how to spray in order not to jeopardize or set health risks on the environment CFD simulation using ANSYS Investigate the influence of spray application technology on the amount of spray drift from field crop sprayers Bart Nicolai MeBIOS, Biosystems Department KU Leuven

9 HPC use case: Assembling the 25Gb genome of Pinus pinaster Using the HPC shared memory infrastructure enables us to assemble these large genomes which requires 7.2TB of memory for the sequencing dataset The genomes of conifers are amongst the largest ones known Lieven Sterck Plant Systems Biology, VIBUGent

10 Did you know that HPC is also used for? Animation Packaging Big data Rendering of images in animation movies Testing of new packaging materials and shapes Economical, historical, behavioral data Food industry Aerodynamics Optimization of production and quality systems Controlled aerodynamics of Pringles on the conveyor belt Automotive design Space industry Design and safety Design of spacecrafts Medical industry Medical device and drug testing

11 Supercomputing in Flanders: VSC Virtual organization Collaboration of the 5 Flemish universities associations o Created in 2007 o Structural funding Mission o HPC for research o Infrastructure Maintenance Expertise Funded by EWI and FWO

12 VSC HPC environment Tier PF Tier TF 16,240 CPU cores 128/256 GB memory/node IB EDR interconnect Tier -2 Tier -3 HOPPER/TURING Laptop, workstation Specialized resources STEVIN THINKING/CEREBRO HYDRA

13 VSC Staff 28 FTE User support Services Infrastructure Datacenter Linux admin Network

14 So, how does it look like?

15 There was some room left in the datacenter

16 BrENIAC The Flemish Supercomputer Brain + ENIAC

17 BrENIAC specs

18 Top500 list June 2016 #55 Europa #72 Green500

19 VSC and Belnet old setup Tier-1 system at Gent Tier-2 systems at Antwerp, Brussels, Leuven these needed to be connected Belnet point-2-point links used to build a private network Tier-2 Antwerp protected path Tier-1 Gent Tier-2 Brussels Tier-2 Leuven/Hasselt

20 But now BrENIAC is opening in Leuven time to take a closer look at the VSC network setup current setup with star topology centered at Gent is no longer optimal unprotected paths offer little redundancy alternating Tier-1 at Gent and Leuven poses problems 2 high-speed ports needed per link question discussed with Belnet CAN WE DO BETTER? Yes we can!

21 the solution put Belnet at the center simple & elegant idea - Belnet as a central routing hub all VSC sites are equidistant o o location of the TIER-1 site doesn t matter, can easily change in the future without changing topology optimal routing between all sites, both for Tier1-to-Tier2 and for Tier2-to-Tier2 PLUS we need less ports o 1 high-speed port per added site, instead of 2

22

23 Bonus advantage 1 - redundancy redundancy is built-in thanks to the highly meshed Belnet backbone additionaly adding bandwidth is easy just change the local port (10GE => 2x10GE => => 100GE)

24 Bonus advantage 2 adding partners partnering with the VSC is easy o just connect a VSC port to the Belnet network VSC easy access to BrENIAC Tier-1 Flemish supercomputer for research institutes and industry new partner

25 BrENIAC is ready for business Jan Ooghe Herman Moons