Yesterday, I had an opportunity to visit the German Climate Computing Centre (Deutsches Klimarechenzentrum – DKRZ) here in Hamburg to learn more about their research and tour their data center.
They recently installed a new supercomputer named HLRE-4 Levante, and it was very impressive. What surprised me most was how quiet a data center can be inside when it’s water-cooled.
Some specs of this system include:
- 2,832 compute nodes
- Peak performance: 14 PetaFLOPS
- Main memory (total): 815 Terabyte
- 60 GPU nodes each equipped with 2 AMD 7713 CPUs (main memory 512 Gigabyte) and 4 Nvidia A100 GPUs
- Peak performance: : 2.8 PetaFLOPS
- Main memory: approx. 30 Terabyte
- Graphics memory: approx. 5 Terabyte
- Networking: NVIDIA Mellanox InfiniBand HDR 100G/200G
- Disk storage: 130 Petabyte (Lustre) by DDN
- Long-term storage is performed via an array of 8 Oracle/StorageTek SL8500 tape libraries (over 300 Petabytes total capacity)
I took some pictures that you can find here – enjoy!