Table of Contents

Parallel I/O and Storage

Application demands for IO such as writing checkpoint and movie files threaten to outpace the capabilities of IO subsystems to satisfy those demands, especially as system scales increase to the Petascale and beyond. The ORNL Future Technologies Group is investigating IO for these extreme-scale computing IO challenges. We study application IO demands (including how to determine those demands), how well current and expected IO solutions meet those demands, and how to address the gap between application demands and achievable performance.

Recent Publications

"Design, Implementation, and Evaluation of Transparent pNFS on Lustre" PDF
Yu,W.,Drokin,O.,Vetter,J.S.
23rd IEEE International Parallel and Distributed Processing Symposium (IPDPS'09), 2009

"Performance of RDMA-capable Storage Protocols on Wide-Area Network" PDF
Yu,W.,Rao,N.S.V.,Wyckoff,P.,Vetter,J.S.
Peta-Byte Storage Workshop 2008 (PDSW08), 2008

"Empirical Analysis of a Large-Scale Hierarchical Storage System" PDF
Yu,W.,Oral,H.S.,Canon,R.S.,Vetter,J.S.,Sankaran,R.
The 14th European Conference on Parallel and Distributed Computing (Euro-Par 2008), 2008

"ParColl: Partitioned Collective IO on the Cray XT" PDF
Yu,W.,Vetter,J.S.
The 37th International Conference on Parallel Processing., 2008

"Performance Characterization and Optimization of Parallel I/O on the Cray XT" PDF
Yu,W.,Vetter,J.S.,Oral,H.S.
22nd IEEE International Parallel and Distributed Processing Symposium (IPDPS'08)., 2008

"Xen-Based HPC: A Parallel IO Perspective" PDF
Yu,W.,Vetter,J.S.,
8th IEEE International Symposium on Cluster Computing and the Grid (CCGrid'08)., 2008

"FlexFetch: A History-Aware Scheme for I/O Energy Saving in Mobile Computing" PDF
Chen,Feng,Jiang,Song,Shi,Weisong,Yu,Weikuan
International Conference on Parallel Processing (ICPP-07), 2007

"OPAL: An Open-Source MPI-IO Library over Cray XT" PDF
Yu,Weikuan,Vetter,Jeffrey,Canon,Shane
International Workshop on Storage Network Architecture and Parallel I/O (SNAPI'07). Held together with IEEE Conference on Mass Storage Systems and Technologies, 2007

"Exploiting Lustre File Joining for Effective Collective IO" PDF
Yu,W.,Vetter,J.S.,Canon,R.S.,Jiang,S.
Int'l Conference on Clusters Computing and Grid (CCGrid '07), 2007

"Efficiency Evaluation of Cray XT Parallel IO Stack" PDF
Yu,Weikuan,Oral,Sarp,Vetter,Jeffrey,Barrett,Richard
Cray User Group Meeting (CUG 2007), 2007

You can find more publications and downloadable citations at FT Public Publications.

Participants

Staff

Partners

Sponsors