Skip to content

Commit

Permalink
Update supercomputer_setup.md
Browse files Browse the repository at this point in the history
  • Loading branch information
ktiits authored Jun 20, 2024
1 parent e96a577 commit 8da60ad
Showing 1 changed file with 29 additions and 0 deletions.
29 changes: 29 additions & 0 deletions materials/supercomputer_setup.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,35 @@ Typical physical parts of a supercomputer:
- **Disk** refers to all storage that can be accessed like a file system. This is generally storage that can hold data permanently, i.e. data is still there even if the computer has been restarted.
- CSC supercomputers use Lustre as the **parallel distributed file system**

## Puhti disk areas

| Name |Access |Path |Cleaning |Capacity|Number of files| Use |
|------------|--------|--------------------|---------------------|--------------|----------------|----------------|
|**[home](https://docs.csc.fi/computing/disk/#home-directory)** |Personal|`/users/cscusername` |No |10 GiB |100 000 files | personal settings and files |
|**[projappl](https://docs.csc.fi/computing/disk/#projappl-directory)**|Project |`/projappl/project_200xxxx`|No |50 GiB |100 000 files | installation files |
|**[scratch](https://docs.csc.fi/computing/disk/#scratch-directory)** |Project |`/scratch/project_200xxxx` |**180 days** |**1 TiB** |1 000 000 files | main working area |

* `scratch` space can be extended, but it would use billing units then.

### Temporary fast disks

- [CSC Docs: Login node local tmp](https://docs.csc.fi/computing/disk/#login-nodes) `$TMPDIR` for compiling, cleaned frequently.

- [CSC Docs: NVMe](https://docs.csc.fi/computing/running/creating-job-scripts-puhti/#local-storage) - `$LOCAL_SCRATCH` in batch jobs,
- NVMe is accessible only during your job allocation, inc. interactive job
- You must copy data in and out during your batch job
- If your job reads or writes a lot of small files, using this can give 10x performance boost

:::{admonition} Avoid unneccesary reading and writing
:class: seealso
Avoid unnecessary reads and writes of data to improve I/O performance
- Read and write in big chunks and avoid reading/writing lots of small files
- If unavoidable, use [fast local NVMe disk](https://docs.csc.fi/computing/disk/#compute-nodes-with-local-ssd-nvme-disks), not Lustre (i.e. `/scratch`)
:::

## LUMI disk areas
- [LUMI docs: storage](https://docs.lumi-supercomputer.eu/storage/)
- LUMI has similar main disks, but different temporary disks.

:::{admonition} Login node etiquette
:class: tip
Expand Down

0 comments on commit 8da60ad

Please sign in to comment.