||
UCAR recommend us to use GLOBUS for large data transfering. Here is a brief tutorial and to transfer data from Yellowstone GLADE to a server.
First, you need to register on globus. (https://www.globus.org/)
You may want to add your public key on Manage Identities tab (https://www.globus.org/account/ManageIdentities, see http://blog.sciencenet.cn/blog-733034-869783.html for how to generate your public key)
Setting a end point on your computer (cluster, server, whatever)
$ wget https://s3.amazonaws.com/connect.globusonline.org/linux/stable/globusconnect-latest.tgz
--2013-06-07 00:14:10-- https://s3.amazonaws.com/connect.globusonline.org/linux/stable/glob...
Resolving s3.amazonaws.com (s3.amazonaws.com)... 72.21.214.199
Connecting to s3.amazonaws.com (s3.amazonaws.com)|72.21.214.199|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 8291206 (7.9M) [application/x-tar]
Saving to: `globusconnect-latest.tgz'
100%[==============================================================================>] 8,291,206 1010K/s in 8.0s
2013-06-07 00:14:18 (1018 KB/s) - `globusconnect-latest.tgz' saved [8291206/8291206]
$ tar xzf globusconnect-latest.tgz
$ cd globusconnectpersonal-x.y.z
$ ssh username@cli.globusonline.org
Welcome to globusonline.org, demodoc. Type 'help' for help.
$ endpoint-add my-linux-laptop --gc
Created the Globus Connect endpoint 'demodoc#my-linux-laptop'.
Use this setup key when installing Globus Connect:
2a0a5d39-a534-4fe7-b78a-acdb00542c52
$ exit
$ ./globusconnectpersonal -setup 2a0a5d39-a534-4fe7-b78a-acdb00542c52
Configuration directory: /home/go_user/.globusonline/lta
Contacting relay.globusonline.org:2223
Installing certificate and key
Creating /home/go_user/.globusonline/lta/gridmap
Done!
$ ./globusconnectpersonal -start &
[1] 15268
$ ssh username@cli.globusonline.org endpoint-activate my-linux-laptop
after this, you can only access to your home directory from GLOBUS, you may need to modify /.globusonline/lta/config-paths
You will see:
~/,0,1
If you want to add /data/you directory to the authorized directories, add this line
/data/you/, 0,1
Then you need to restart globus.
$ ./globusconnectpersonal -stop
$ ./globusconnectpersonal -start &
Then, your end point is set. You may set yellowstone end point at Manage Data (https://www.globus.org/xfer/StartTransfer ).
Then, you are good to transfer your data.
Reference:
(Okay, I just put the stuff together after all.)
https://support.globus.org/entries/24078973
Archiver|手机版|科学网 ( 京ICP备07017567号-12 )
GMT+8, 2023-12-12 06:57
Powered by ScienceNet.cn
Copyright © 2007- 中国科学报社