Silo & HDF5 I/O Scaling Improvements on BG/P Systems Metadata

Metadata describes a digital item, providing (if known) such information as creator, publisher, contents, size, relationship to other resources, and more. Metadata may also contain "preservation" components that help us to maintain the integrity of digital files over time.

Available Formats

Dublin Core: XML Dublin Core: JSON Dublin Core: Text Dublin Core: RDF/XML UNTL: XML Access METS: XML

Title

  • Main Title Silo & HDF5 I/O Scaling Improvements on BG/P Systems

Creator

  • Author: Collette, M R
    Creator Type: Personal
  • Author: Miller, M C
    Creator Type: Personal

Contributor

  • Sponsor: United States. Department of Energy.
    Contributor Type: Organization

Publisher

  • Name: Lawrence Livermore National Laboratory
    Place of Publication: Livermore, California
    Additional Info: Lawrence Livermore National Laboratory (LLNL), Livermore, CA

Date

  • Creation: 2010-12-02

Language

  • English

Description

  • Content Description: Silo and HDF5 are I/O libraries used by many codes important to the LLNL's Weapons and Complex Integration (WCI) mission. In the past year, modest adjustments and tuning of Silo, HDF5 and the I/O configuration of the BG/P platform, Dawn, were undertaken. A key goal of this work was to improve I/O performance without requiring any changes in the application codes themselves. In particular, the application codes have been allowed to continue to use a simplified yet highly flexible I/O paradigm known as 'Poor Man's Parallel I/O', where scalability is achieved through concurrent, serial I/O to multiple files. The results demonstrate substantial performance gains (better than 50x in many cases) at large scale (greater than 64,000 MPI tasks). They describe key enhancements made to Silo, HDF5 and the I/O configuration of our BG/P platform and present very favorable results from scalability studies over a wide range of operating scenarios.
  • Physical Description: PDF-file: 1 pages; size: 0.9 Mbytes

Subject

  • Keyword: Tuning
  • STI Subject Categories: 97 Mathematics, Computing, And Information Science
  • Keyword: Computer Codes
  • Keyword: Configuration
  • Keyword: Performance
  • Keyword: Weapons

Source

  • Conference: Presented at: NECDC 2010, Los Alamos, NM, United States, Oct 18 - Oct 22, 2010

Collection

  • Name: Office of Scientific & Technical Information Technical Reports
    Code: OSTI

Institution

  • Name: UNT Libraries Government Documents Department
    Code: UNTGD

Resource Type

  • Article

Format

  • Text

Identifier

  • Report No.: LLNL-CONF-463573
  • Grant Number: W-7405-ENG-48
  • Office of Scientific & Technical Information Report Number: 1018434
  • Archival Resource Key: ark:/67531/metadc841235
Back to Top of Screen