Document Actions
2. Resource description
Up to Table of Contents
|
|
| The Stallo cluster. Photo and copyright: Thilo Bubek |
| Aggregated |
Per node |
|||
| Peak performance | 60 Teraflop/s | 85,12 Gigaflop/s | ||
| # Nodes |
704 x HP BL460c blade servers |
1 x HP BL460c blade server |
||
| # CPU's / # Cores | 1408 / 5632 |
2 / 8 |
||
| Processors | 1408 x 2.66 GHz Intel Xeon X5355 Quad Core |
2 x 2.66 GHz Intel Xeon X5355 Quad Core | ||
| Total memory | 12 TB |
16 GB (50 nodes with 32 GB) |
||
| Internal storage |
84,5 TB | 120 GB |
||
| Centralized storage |
128 TB |
128 TB |
||
| Interconnect | Gigabit Ethernet + Infiniband1 | Gigabit Ethernet + Infiniband1 |
||
| Compute racks |
11 |
|||
| Infrastructure racks |
2 |
|||
| Storage racks |
4 |
|||
| Dimensions (wxdxh) |
15 m x 1,3 m x 2 m |
|||
| Weight |
16 tons |
1) All nodes in the cluster are connected with Gigabit Ethernet, and 384 nodes are also connected with Infiniband.
Stallo - a Linux cluster
A quick and brief introduction to the general features of Linux Clusters / Stallo is available on the Metasenter page about Linux Clusters.
Linux operation system (Rocks): 
Since 2003, the HPC-group at has been one of five international development sites for the Linux operation system Rocks. Together with people in Singapore, Thailand, Korea and USA, we have developed a tool that has won international recognition, such as the price for "Most important software innovation" both in 2004 and 2005 in HPCWire. Now Rocks is a de-facto standard for cluster-managment in Norwegian supercomputing.
Storage configuration
Stallo has a "three folded" file system:
- a global accessible home area: /home (32 TB)
- a global accessible work / scratch area: /global/work (95 TB)
- a local accessible work / scratch area on each node: /local/work (~90 GB)
Home area
There is a 32 TB global accessible home area on the cluster, which is accessible from both the login nodes and all the compute nodes. The default size of the home directory's for each user are 50 GB. If more space is needed for permanent storage users have to apply for it. Please contact the system administrators, support-uit@notur.no, for more information about this.
The home area is for "permanent" storage only, so please do not use it for temporary storage during production runs.
Jobs using the home area for scratch files while running may be killed without any warning.
Work / scratch areas
There are two different work / scratch areas available on Stallo:
- There are an 95 TB global accessible work area on the cluster. This is accessible from both the login nodes and all the compute nodes as /global/work. This is the recommended work area, both because of size and performance!
- In addition, each compute node has a small work area of approximately 90 GB, only locally accessible on each node. This area is accessible as /local/work on each compute node. In general we do not recommend to use /local/work, both because of (the lack of) size and performance, however for some users this may be the best alternative.
These work areas should be used for all jobs running on Stallo.
After a job has finished old files should be deleted, this is to ensure that there are plenty of available space for new jobs. Files left on the work areas after a job has finished may be removed without any warning.
There are no backup of files stored on the work areas.
If you need permanent storage of large amounts of data, please contact the system administrators: support-uit@notur.no
Backup
Backup is taken of all files stored on /home. A full dump backup is made every week and stored for 3 months.
There are no backup of files stored on the work areas.
If you need permanent storage of large amounts of data, please contact the system administrators: support-uit@notur.no
