Friday, October 5, 2007

GridFTP with BigRed/Data Capacitor and HPSS - Idiot's Guide

Finally I received a username and password to open the magic door to TeraGrid. In another moment down went Alice after it, never once considering how in the world she was to get out again.

Simplest steps to GridFTP zeros with BigRed and HPSS follow:

  1. Refer to the general TeraGrid single sign-on guide. An example session from gf1.ucs.indiana.edu:
    $ export GLOBUS_LOCATION=/home/globus/nmi-8.0-rh9/
    $ source /home/globus/nmi-8.0-rh9/etc/globus-user-env.sh
    $ export MYPROXY_SERVER=myproxy.teragrid.org
    $ export MYPROXY_SERVER_PORT=7514
    $ mkdir -p ~/.globus/certificates
    $ cd ~/.globus/certificates
    $ wget http://ca.ncsa.uiuc.edu/4a6cd8b1.0
    $ wget http://ca.ncsa.uiuc.edu/4a6cd8b1.signing_policy
    $ wget http://ca.ncsa.uiuc.edu/4a6cd8b1.r0
    $ myproxy-logon -T -l myusername
    Enter MyProxy pass phrase:
    A credential has been received for user myusername in /tmp/x509up_u1209.

  2. Login to BigRed using gsissh
    $ gsissh tg-login.iu.teragrid.org

  3. Start transfer zeros:
    $globus-url-copy -vb gsiftp://gridftp.bigred.iu.teragrid.org/N/dc/scratch/myusername/8GB gsiftp://gridftp.mdss.iu.edu/hpss/m/y/username/
    8388608000 bytes 75.40 MB/sec avg 36.36 MB/sec inst

  4. Not bad, right? ;) Just make sure the absolute file paths of both source and destination are correct.

  5. Oh, and my ~/.soft on BigRed looks like:
    @bigred
    @teragrid-basic
    @globus-4.0
    @teragrid-dev

No comments: