Institute for Condensed Matter Physics (ICMP) of the NAS of Ukraine

The ICMP computer cluster consists of 17 computational nodes, 1 coordinating node, and 3 data storage system nodes. There are 136 2.0GHz Intel Xeon E5405 CPUs available for a computing work, giving the total peak productivity of about 1.1 TFlops. At the same time the LINPACK tests show the productivity around 850 Gflops, reached due to the high-speed Infiniband connection with 10 Gb/s two-way bandwidth.

All the software used on the ICMP cluster is free software. The operating system in use is the Rocks Linux distribution, developed specially for computing clusters. The SGE queuing system is used to control the tasks submitted for computing. Parallel tasks can run through the OpenMPI library. The Intel compiler and MKL library are available besides the standard gcc compilers. A big set of various numerical libraries is present as well.

The present capacity of data storage system is 4TB. It was built on the basis of a RAID-5 hard drive array of 1TB disks, and the high-end Lustre file system. In case of a hard disk failure the system is able to hot-swap the hard drives.

The cluster is connected to the Ukrainian academic network though an optical fiber cable with 1 Gb/s bandwidth and is part of national GRID project.

Cluster structure

 

Fronend

2х Intel® Xeon® CPU E5130, 4Gb memory, 2x500Gb HDD
Rocks 5.3 OS, kernel 2.6.18-164.11.1.el5_lustre.1.8.3

 

Computing nodes (17 nodes)

2х Intel® Xeon® CPU E5405, 16Gb memory, 80Gb HDD
Rocks 5.3 OS, kernel 2.6.18-164.11.1.el5_lustre.1.8.3

 

Data storage system

Storage system is built on Lustre file system and consists of three nodes with hard disks combined into RAID arrays. One node is a head node of the Lustre server (MDS) and the remaining two are actual storage nodes (OSS).

 

Network

All the computing nodes are connected by the Infiniband 4x DDR network,
network card MHES18-XTC,
network commutator Mallanox MTS2400 InfiniBand HCA 24-Port HCA Switch.
This network is used for communication between parallel user tasks. The connection between computing nodes and Lustre file server is through Gigabit Ethernet.

Manager: Patsahan Taras
System administrator: Farenyuk Oleg
Address: 1 Svientsitskii Street, 79011 Lviv, Ukraine
Phone: +38 032 2760614
E-mail: tarpa@icmp.lviv.ua