ALERT! Warning: your browser isn't supported. Please install a modern one, like Firefox, Opera, Safari, Chrome or the latest Internet Explorer. Thank you!
Startseite » ... » Zentrale Einrichtungen  » ZIH  » Wiki
phone prefix: +49 351 463.....

HPC Support

Operation Status

Ulf Markwardt: 33640
Claudia Schmidt: 39833

Login and project application

Phone: 40000
Fax: 42328

You are here: Compendium » DataManagement » DataMover

Transferring files between HPC systems

We provide a special data transfer machine providing the global file systems of each ZIH HPC system. This machine is not accessible through SSH as it is dedicated to data transfers. To move or copy files from one file system to another file system you have to use the following commands:
  • dtcp, dtls, dtmv, dtrm, dtrsync, dttar

These commands submit a job to the data transfer machines performing the selected command. Except the following options their syntax is the same than the shell command without dt prefix (cp, ls, mv, rm, rsync, tar).

Additional options:
--account=ACCOUNT Assign data transfer job to specified account.
--blocking Do not return until the data transfer job is complete. (default for dtls)
--time=TIME Job time limit (default 18h).

  • dtinfo, dtqueue, dtq, dtcancel

dtinfo shows information about the nodes of the data transfer machine (like sinfo). dtqueue and dtq shows all the data transfer jobs that belong to you (like squeue -u $USER). dtcancel signals data transfer jobs (like scancel).

To identify the mount points of the different HPC file systems on the data transfer machine, please use dtinfo. It shows an output like this (attention, the mount points can change without an update on this web page) :
HPC system Local directory Directory on data transfer machine
Taurus, Venus /scratch /scratch
  /lustre/ssd /lustre/ssd
  /home /home
  /projects /projects
Archive /archiv
Group Storages /grp/<group storage>

How to copy your data from an old scratch (Atlas, Triton, Venus) to our new scratch (Taurus)

You can use our tool called Datamover to copy your data from A to B.
dtcp -r /scratch/<project or user>/<directory> /projects/<project or user>/<directory> # or
dtrsync -a /scratch/<project or user>/<directory> /lustre/ssd/<project or user>/<directory>

Options for dtrsync:

-a, --archive               archive mode; equals -rlptgoD (no -H,-A,-X)

-r, --recursive             recurse into directorie
-l, --links                 copy symlinks as symlinks
-p, --perms                 preserve permissions
-t, --times                 preserve modification times
-g, --group                 preserve group
-o, --owner                 preserve owner (super-user only)
-D                          same as --devices --specials


dtcp -r /scratch/rotscher/results /luste/ssd/rotscher/ # or
new: dtrsync -a /scratch/rotscher/results /home/rotscher/results

Examples on how to use data transfer commands:

Copying data from Taurus' /scratch to Taurus' /projects
% dtcp -r /scratch/jurenz/results/ /home/jurenz/

Moving data from Venus' /sratch to Taurus' /luste/ssd
% dtmv /scratch/jurenz/results/ /lustre/ssd/jurenz/results

TGZ data from Taurus' /scratch to the Archive
% dttar -czf /archiv/jurenz/taurus_results_20140523.tgz /scratch/jurenz/results

Note: Please do not generate files in the archive much larger that 500 GB.