Appendix E: MetaArchive-iRODS Transfer

One of 8 texts in the series: MetaArchive Cooperative available on this site.

PDF Version Also Available for Download.

Description

This is an appendix to the MetaArchive Final Report. This appendix document describes an automation process that involved the sending of a Folger Shakespeare Library collection (246 archival units measuring 1.3TB) hosted on a University of North Texas (UNT) LOCKSS cache to a storage resource hosted by Chronopolis at the San Diego Supercomputer Center (SDSC).

Physical Description

4 p.

Creation Information

Halbert, Martin; Hartman, Cathy Nelson; Skinner, Katherine; Walters, Tyler & Schultz, Matt March 9, 2012.

Context

This text is part of the collection entitled: UNT Scholarly Works and was provided by UNT Libraries to Digital Library, a digital repository hosted by the UNT Libraries. It has been viewed 115 times . More information about this text can be viewed below.

Who

People and organizations associated with either the creation of this text or its content.

Authors

Provided By

UNT Libraries

With locations on the Denton campus of the University of North Texas and one in Dallas, UNT Libraries serves the school and the community by providing access to physical and online collections; The Portal to Texas History and UNT Digital Libraries; academic research, and much, much more.

Contact Us

What

Descriptive information to help identify this text. Follow the links below to find similar items on the Digital Library.

Titles

Degree Information

Description

This is an appendix to the MetaArchive Final Report. This appendix document describes an automation process that involved the sending of a Folger Shakespeare Library collection (246 archival units measuring 1.3TB) hosted on a University of North Texas (UNT) LOCKSS cache to a storage resource hosted by Chronopolis at the San Diego Supercomputer Center (SDSC).

Physical Description

4 p.

Notes

Abstract: This appendix document describes an automation process that involved the sending of a Folger Shakespeare Library collection (246 archival units measuring 1.3TB) hosted on a University of North Texas (UNT) LOCKSS cache to a storage resource hosted by Chronopolis at the San Diego Supercomputer Center (SDSC). In order to transfer the content to the iRODS-based Chronopolis data grid, each archival unit needed to be extracted from the LOCKSS cache, and sent via use of the iRODS icommands client utilities. In addition, it was imperative to monitor the transfer at all possible points to detect corruption and make certain that the integrity of the data was maintained. Finally, for the purpose of benchmarking and information gathering, time-based statistics needed to be recorded for each stage of the transfer. These processes were managed by a set of Python-based scripts and utilities that are described in this document.

Language

Item Type

Relationships

Collections

This text is part of the following collection of related materials.

UNT Scholarly Works

Materials from the UNT community's research, creative, and scholarly activities and UNT's Open Access Repository. Access to some items in this collection may be restricted.

Related Items

MetaArchive: Final Report (Report)

MetaArchive: Final Report

This report provides summary information about the goals, activities, and results of this project, focusing on January 2008-December 2011. Section One will provide a brief summary of the outcomes of the project work based on the authors' project's performance objectives. Section Two will offer a brief reiteration of the authors' project's original goals and ambitions and an in-depth discussion of the authors' findings and development activities. Section Three will describe plans for the program's continuation and its long-term impact. Section Four will provide a list of the staff who have worked on various aspects of this project during the project period.

Relationship to this item: (Is Referenced By)

MetaArchive: Final Report, ark:/67531/metadc109710

What responsibilities do I have when using this text?

When

Dates and time periods associated with this text.

Creation Date

  • March 9, 2012

Added to The UNT Digital Library

  • Oct. 14, 2012, 9:37 p.m.

Description Last Updated

  • April 28, 2014, 4:27 p.m.

Usage Statistics

When was this text last used?

Yesterday: 0
Past 30 days: 1
Total Uses: 115

Interact With This Text

Here are some suggestions for what to do next.

Start Reading

PDF Version Also Available for Download.

Citations, Rights, Re-Use

Halbert, Martin; Hartman, Cathy Nelson; Skinner, Katherine; Walters, Tyler & Schultz, Matt. Appendix E: MetaArchive-iRODS Transfer, text, March 9, 2012; (digital.library.unt.edu/ark:/67531/metadc109716/: accessed October 16, 2017), University of North Texas Libraries, Digital Library, digital.library.unt.edu; .