Improving the bulk data transfer experience Page: 1 of 8
This article is part of the collection entitled: Office of Scientific & Technical Information Technical Reports and was provided to Digital Library by the UNT Libraries Government Documents Department.
The following text was automatically extracted from the image on this page using optical character recognition software:
Improving the Bulk Data Transfer
Chin Guok*, Jason R Lee, Karlo Berket
Lawrence Berkeley National Laboratory
1 Cyclotron Rd MS 50A-3125, Berkeley, CA 94720, USA
E-Mail kberket @lbl.gov
Abstract: Scientific computations and collaborations increasingly rely on the network to
provide high-speed data transfer, dissemination of results, access to instruments, support for
computational steering, etc. The Energy Sciences Network is establishing a science data
network to provide user driven bandwidth allocation. In a shared network environment,
some reservations may not be granted due to the lack of available bandwidth on any single
path. In many cases, the available bandwidth across multiple paths would be sufficient to
grant the reservation. In this paper we investigate how to utilize the available bandwidth
across multiple paths in the case of bulk data transfer.
Keywords: bulk data transfer; performance measurement; performance improvement; user
driven bandwidth allocation; bandwidth reservation; traffic engineering; overlay networks;
high-speed data transfer; science data network
Reference to this paper should be made as follows: Weng, T-h. and Chapman, B. (2004)
'Towards optimisation of openMP codes for synchronisation and data reuse', Int. J. High
Performance Computing and Networking, Vol. 1, Nos. 1/2/3, pp.43-54.
Biographical notes: Chin Guok joined ESnet in 1997 as a Network Engineer, focusing
primarily on network statistics. Chin received his Masters Degree in Computer Science
from the University of Arizona. He is currently the principle investigator of the ESnet On-
demand Secure Circuit and Advance Reservation System (OSCARS) project.
Jason Lee is a Network Engineer with the National Energy Research Scientific Computing
Center (NERSC). Jason received his Masters Degree in Computer Science from SFSU.
Jason has spent the last 15 years at LBNL working in network research. His current
interests include 100G networking and provisioning network resources within a
Dr. Karlo Berket is a Scientist in the Distributed Systems Department at the Lawrence
Berkeley National Laboratory (LBNL). He received his Doctorate degree in Computer
Engineering for his work on the InterGroup group communication system at the University
of California, Santa Barbara. His current research interests include overlay networks and
semantic management of metadata.
The practice of modern science is increasingly dominated
by large-scale collaborations of multi-disciplinary teams
integrating results from both simulation and observation.
Scientific computations and collaborations increasingly rely
on the network to provide high-speed data transfer,
dissemination of results, access to instruments, support for
computational steering, etc. The data sets that need to be
shared are increasingly reaching sizes in the terabyte (TB)
range. This makes the function of the network increasingly
critical to the success of such cooperative efforts. Recent
news reports (Farivar, 2007; Waters, 2007) have picked up
on the efforts to transfer the entire collection of Hubble
telescope data (about 120 terabytes) to scientists at various
research institutions by shipping hard disks via mail,
because it's faster than sending it over the network.
Advances in storage and network technologies will help
speed up bulk data transfers, but we can also improve
performance by utilizing our current resources more wisely.
To address some of these issues, the Energy Sciences
Network (ESnet) (Energy Sciences Network, 2007) is
establishing a science data network that is logically separate
from the production IP core network. This will provide the
Here’s what’s next.
This article can be searched. Note: Results may vary based on the legibility of text within the document.
Tools / Downloads
Get a copy of this page or view the extracted text.
Citing and Sharing
Basic information for referencing this web page. We also provide extended guidance on usage rights, references, copying or embedding.
Reference the current page of this Article.
Guok, Chin; Guok, Chin; Lee, Jason R. & Berket, Karlo. Improving the bulk data transfer experience, article, May 7, 2008; Berkeley, California. (digital.library.unt.edu/ark:/67531/metadc901840/m1/1/: accessed December 19, 2018), University of North Texas Libraries, Digital Library, digital.library.unt.edu; crediting UNT Libraries Government Documents Department.