Chapter 27. dCache Clients

Table of Contents

• The SRM Client Suite

srmcp — Copy a file from or to an SRM or between two SRMs.

• dccp dccp — Copy a file from or to a dCache server.

The SRM Client Suite

An SRM URL has the form srm://dmx.lbl.gov:6253//srm/DRM/srmv1?SFN=/tmp/try1 and the file URL looks like file:////tmp/aaa.

srmcp

srmcp - Copy a file from or to an SRM or between two SRMs.

synopsis

srmcp|option…|sourceUrl destUrl

Arguments sourceUrl The URL of the source file.

destUrl The URL of the destination file.

Options

gss_expected_name

To enable the user to specify the gss expected name in the DN (Distinguished Name) of the srm server. The default value is host.

Example: If the CN of host where srm server is running is CN=srm/tam01.fnal.gov, then gss_expected_name should be srm.

srmcp --gss_expected_name=srm sourceUrl destinationUrl

globus_tcp_port_range

To enable the user to specify a range of ports open for tcp connections as a pair of positive integers separated by “:”, not set by default.

This takes care of compute nodes that are behind firewall.

Example: globus_tcp_port_range=40000:50000

srmcp --globus_tcp_port_range=minVal:maxVal sourceUrl destinationUrl

streams_num

To enable the user to specify the number of streams to be used for data transfer. If set to 1, then stream mode is used, otherwise extended block mode is used.

Example:

srmcp --streams_num=1 sourceUrl destinationUrl

server_mode To enable the user to set the (gridftp) server mode for data transfer. Can be active or passive, passive by default.

This option will have effect only if transfer is performed in a stream mode (see streams_num)

Example:

srmcp --streams_num=1 --server_mode=active sourceUrl destinationUrl

dccp

dccp — Copy a file from or to a dCache server.

Synopsis

dccp [option…]

Arguments

The following arguments are required:

sourceUrl

The URL of the source file.

destUrl

The URL of the destination file.

Description

The dccp utility provides a cp(1) like functionality on the dCache file system. The source must be a single file while the destination could be a directory name or a file name. If the directory is a destination, a new file with the same name as the source name will be created there and the contents of the source will be copied. If the final destination file exists in dCache, it won’t be overwritten and an error code will be returned. Files in regular file systems will always be overwritten if the -i option is not specified. If the source and the final destination file are located on a regular file system, the dccp utility can be used similar to the cp(1) program.

Options

The following arguments are optional:

-a

Enable read-ahead functionality.

-b

Set read-ahead buffer size. The default value is 1048570 Bytes. To disable the buffer this can be set to any value below the default. dccp will attempt to allocate the buffer size so very large values should be used with care.

-B

Set buffer size. The size of the buffer is requested in each request, larger buffers will be needed to saturate higher bandwidth connections. The optimum value is network dependent. Too large a value will lead to excessive memory usage, too small a value will lead to excessive network communication.

-d

Set the debug level. <debug level> is a integer between 0 and 127. If the value is 0 then no output is generated, otherwise the value is formed by adding together one or more of the following values:

Value Enabled output 1 Error messages 2 Info messages 4 Timing information 8 Trace information 16 Show stack-trace 32 IO operations 32 IO operations 64 Thread information

-h

Bind the callback connection to the specific hostname interface.

-i

Secure mode. Do not overwrite the existing files.

-l

Set location for pre-stage. if the location is not specified, the local host of the door will be used. This option must be used with the -P option.

-p <first_port>:<last_port>

Bind the callback data connection to the specified TCP port/rangeSet port range. Delimited by the ’:’ character, the <first_port> is required but the <last_port> is optional.

-P

Pre-stage. Do not copy the file to a local host but make sure the file is on disk on the dCache server.

-r

TCP receive buffer size. The default is 256K. Setting to 0 uses the system default value. Memory useage will increase with higher values, but performance better.

-s

TCP send buffer size. The default is 256K. Setting to 0 uses the system default value.

-t

Stage timeout in seconds. This option must be used with the -P option.

Examples:

To copy a file to dCache:

dccp /etc/group dcap://example.org/pnfs/desy.de/gading/

To copy a file from dCache:

dccp dcap://example.org/pnfs/desy.de/gading/group /tmp/

Pre-Stage request:

dccp -P -t 3600 -l example.org /acs/user_space/data_file

stdin:

tar cf - data_dir | dccp - /acs/user_space/data_arch.tar

stdout:

dccp /acs/user_space/data_arch.tar - | tar xf -

See also

cp