reasonzhang的个人博客分享 http://blog.sciencenet.cn/u/reasonzhang

博文

Transfer data using GLOBUS

已有 4256 次阅读 2015-2-24 05:37 |个人分类:经验|系统分类:科研笔记

UCAR recommend us to use GLOBUS for large data transfering. Here is a brief tutorial and to transfer data from Yellowstone GLADE to a server.

First, you need to register on globus. (https://www.globus.org/) 

You may want to add your public key on Manage Identities tab (https://www.globus.org/account/ManageIdentities,  see http://blog.sciencenet.cn/blog-733034-869783.html for how to generate your public key)


Setting a end point on your computer (cluster, server, whatever)

$ wget https://s3.amazonaws.com/connect.globusonline.org/linux/stable/globusconnect-latest.tgz
--2013-06-07 00:14:10-- https://s3.amazonaws.com/connect.globusonline.org/linux/stable/glob...
Resolving s3.amazonaws.com (s3.amazonaws.com)... 72.21.214.199
Connecting to s3.amazonaws.com (s3.amazonaws.com)|72.21.214.199|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 8291206 (7.9M) [application/x-tar]
Saving to: `globusconnect-latest.tgz'

100%[==============================================================================>] 8,291,206 1010K/s in 8.0s

2013-06-07 00:14:18 (1018 KB/s) - `globusconnect-latest.tgz' saved [8291206/8291206]
$ tar xzf globusconnect-latest.tgz
$ cd globusconnectpersonal-x.y.z

$ ssh username@cli.globusonline.org
Welcome to globusonline.org, demodoc. Type 'help' for help.
$ endpoint-add my-linux-laptop --gc
Created the Globus Connect endpoint 'demodoc#my-linux-laptop'.
Use this setup key when installing Globus Connect:
   2a0a5d39-a534-4fe7-b78a-acdb00542c52
$ exit

$ ./globusconnectpersonal -setup 2a0a5d39-a534-4fe7-b78a-acdb00542c52
Configuration directory: /home/go_user/.globusonline/lta
Contacting relay.globusonline.org:2223
Installing certificate and key
Creating /home/go_user/.globusonline/lta/gridmap
Done!

$ ./globusconnectpersonal -start &
[1] 15268
$ ssh username@cli.globusonline.org endpoint-activate my-linux-laptop


after this, you can only access to your home directory from GLOBUS, you may need to modify /.globusonline/lta/config-paths

You will see:

~/,0,1

If you want to add /data/you directory to the authorized directories, add this line

/data/you/, 0,1

Then you need to restart globus.

$ ./globusconnectpersonal -stop

$ ./globusconnectpersonal -start &


Then, your end point is set. You may set yellowstone end point at Manage Data (https://www.globus.org/xfer/StartTransfer ).


Then, you are good to transfer your data.


Reference:

(Okay, I just put the stuff together after all.)

https://support.globus.org/entries/84293408-Globus-Connect-Personal-for-Linux-Configuring-Accessible-Directories

https://support.globus.org/entries/24078973



https://blog.sciencenet.cn/blog-733034-869785.html

上一篇:Set up your Mac/Linux and avoid double logging in (ssh->ssh)
收藏 IP: 128.61.55.*| 热度|

0

该博文允许注册用户评论 请点击登录 评论 (0 个评论)

数据加载中...

Archiver|手机版|科学网 ( 京ICP备07017567号-12 )

GMT+8, 2024-4-30 18:55

Powered by ScienceNet.cn

Copyright © 2007- 中国科学报社

返回顶部