CRPC-TR93357-S

Title:    Scalable I/O for Out-of-Core Structures

Authors:  Ken Kennedy, Charles Koelbel, Mike Paleczny

Date:     November 1993, Revised: July 1994


Of the authors listed above, please indicate which are:

  Minority authors:

  Female authors:    

  Student authors:   Mike Paleczny


Keywords (list up to 8):

  Out-of-Core, I/O, Compilation Method, Fortran D

Abstract:

   Many computational methods are currently limited by the size of physical 
   memory, the latency of disk storage, and the difficulty of writing an 
   efficient out-of-core version of the application. Although hardware and 
   software support for virtual memory allows the in-core version to be run 
   on larger datasets, the performance is often poor. This is expected because 
   the programming model in most high-level languages  ignores the size of 
   memory (as well as the size of the data cache and number of registers.)  
   We propose to develop practical compiler algorithms that transform an 
   in-core application to efficiently process out-of-core data. This will 
   include transformations to insert the necessary I/O, improve locality, 
   and overlap I/O with computation. In addition, we will determine the 
   analysis necessary to support the program's transformation.   The appli-
   cation of these transformations will require a minimum of additional 
   information from the programmer and will assume a compiler to file-system 
   interface which supports prefetching.
     

Publication History:

  Submitted to:  SHPCC'94, accepted for poster session

  Published in:  
.