秦承志的科学网博客分享 http://blog.sciencenet.cn/u/qincz

博文

栅格地理计算并行I/O研究进展

已有 2849 次阅读 2013-11-19 15:59 |个人分类:科研进展|系统分类:论文交流

Qin C-Z, Zhan L-J, Zhu A-X. How to apply the Geospatial Data Abstraction Library (GDAL) properly to parallel geospatial raster I/O? Transactions in GIS, 2013, doi: 10.1111/tgis.12068.

 

Abstract:

Input/output (I/O) of geospatial raster data often becomes the bottleneck of parallel geospatial processing due to the large data size and diverse formats of raster data. The open-source Geospatial Data Abstraction Library (GDAL), which has been widely used to access diverse formats of geospatial raster data, has been applied recently to parallel geospatial raster processing. This article first explores the efficiency and feasibility of parallel raster I/O using GDAL under three common ways of domain decomposition: row-wise, column-wise, and block-wise. Experimental results show that parallel raster I/O using GDAL under column-wise or block-wise domain decomposition is highly inefficient and cannot achieve correct output, although GDAL performs well under row-wise domain decomposition. The reasons for this problem with GDAL are then analyzed and a two-phase I/O strategy is proposed, designed to overcome this problem. A data redistribution module based on the proposed I/O strategy is implemented for GDAL using a message-passing-interface (MPI) programming model. Experimental results show that the data redistribution module is effective.

 



http://blog.sciencenet.cn/blog-65307-743086.html

上一篇:《浪潮之巅(第二版)》吴军
下一篇:《弄潮儿》査建英

0

该博文允许注册用户评论 请点击登录 评论 (0 个评论)

数据加载中...
扫一扫,分享此博文

Archiver|手机版|科学网 ( 京ICP备07017567号-12 )

GMT+8, 2020-11-26 16:00

Powered by ScienceNet.cn

Copyright © 2007- 中国科学报社

返回顶部