Difference between revisions of "Storage and Backup"
(→Storage) |
(→Storage) |
||
Line 18: | Line 18: | ||
;/home/work-itp (deprecated and replaced by /mnt/ceph) | ;/home/work-itp (deprecated and replaced by /mnt/ceph) | ||
:This directory is globally accessible and can be used by everyone for minor important data which are not worth to be backed up or simply to large for home. This files are not deleted, but if the disk is full we tell you to delete some files. It runs on a raid6 system, that means a disk failure will not result in data loss. It is also served by a dedicated machine (scratch1) and heavy load does not affect the home directories. It is connected with Infiniband and you may get the best performance when using the login server or the compute nodes. It is currently limited to 16 TB. | :This directory is globally accessible and can be used by everyone for minor important data which are not worth to be backed up or simply to large for home. This files are not deleted, but if the disk is full we tell you to delete some files. It runs on a raid6 system, that means a disk failure will not result in data loss. It is also served by a dedicated machine (scratch1) and heavy load does not affect the home directories. It is connected with Infiniband and you may get the best performance when using the login server or the compute nodes. It is currently limited to 16 TB. | ||
− | |||
;/data (some hosts only) | ;/data (some hosts only) |
Revision as of 06:52, 16 May 2019
The storage servers and importand hosts (like the login server) are connected with infiniband. Therefor prefer this host for doing larger file I/O, it will be much faster.
Storage
There are different file systems with different lifetime and redundancy which you can use to store your data.
- your home directory
- This is your primary directory where all settings, your Mail and other important data is saved. It is mounted on every host to /home/YOUR_LOGIN. A backup is done nightly. This file system has an individual limit which you can check with the command 'df'. In change to earlier setups it has no soft limit which you can exceed for a few days. If you have problems with graphical logins or reading mails, first check your disk space.
- /tmp
- This is the counterpart to your home. It is located on the local disk and should be used for temporary data. Unused files are delete after 14 days.
- /mnt/ceph/
- This directory is globally accessible and can be used by everyone for minor important data, which is not worth to be backed up or simply to large for home. This files are not deleted, but if the disk is full we tell you to delete some files. It runs directly as cephfs on our CephCluster, that means a disk or even a host failure will not result in data loss. The Ceph Cluster is connected with Infiniband and you may get the best performance when using the login server or the compute nodes. It is currently limited to 30 TB.
- If you want to use this space please create a sub directory with you login name. All other files and directories will be delete without notice.
- /home/work-itp (deprecated and replaced by /mnt/ceph)
- This directory is globally accessible and can be used by everyone for minor important data which are not worth to be backed up or simply to large for home. This files are not deleted, but if the disk is full we tell you to delete some files. It runs on a raid6 system, that means a disk failure will not result in data loss. It is also served by a dedicated machine (scratch1) and heavy load does not affect the home directories. It is connected with Infiniband and you may get the best performance when using the login server or the compute nodes. It is currently limited to 16 TB.
- /data (some hosts only)
- This is the local disk. It has the same level like /tmp except that it isn't deleted automatically. Data on this partition is silently deleted when reinstalling or upgrading the machine.
Backup
Backups of the home directory and several other important system directories is done nightly.
- There are held 3 generations of a file.
- Overwritten files are stored for 90 days
- A deleted file is stored for 90 days
If you have delete some files and want them restored, please contact the system administrator.