Bibliography

Mainly about Distributed and Log-structured File Systems.

Search sites

Author's papers

Carla Ellis's Publications
Papers by Margo I. Seltzer
Peter Bosch Articles & Huygens & Cut-and-Paste file-system
Michel Ruffin & KitLog
John Wilkes. Disk modeling & File System simulation

Subject related

Parallel I/O sites

Benchmarks

[Chen 93]: Peter M. Chen, David A. Patterson; A New Approach to I/O Performance Evaluation--Self-Scaling I/O Benchmarks, predicted I/O Performance; Proceedings of the 1993 ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems, May 1993, pp. 1-12.; http://www.eecs.umich.edu/~pmchen/sigmetrics93.ps; sigmetrics93.ps.gz

Acess Patterns

[Purakayastha 94]: Apratim Purakayastha, Carla Ellis, David Kotz, Nils Nieuwejaar, and Michael Best; Characterizing Parallel File-Access Patterns on a Large-Scale Multiprocessor; Technical Report CS-1994-33, Oct. 1994. Presented at IPPS95.; http://www.cs.duke.edu/~carla/ap.ps; 1994-33.ps.gz
[Nieuwejaar 95]: Nils Nieuwejaar, David Kotz; Low-level Interfaces for High-level Parallel I/O; Dartmouth PCS-TR95-253; ftp://ftp.cs.dartmouth.edu/TR/TR95-253.ps.Z; TR95-253.ps.gz

Traces

[Baker 91]

Mary G. Baker, John H. Hartman, Michael D. Kupfer, Ken W. Shirriff, John K. Ousterhout

Measurements of a Distributed File System

SOSP '91

ftp://ftp.cs.berkeley.edu/ucb/sprite/papers/measureSOSP91.ps

To bring

[Blaze 92]

Blaze, Matt

NFS Tracing by Passive Network Monitoring

1992

http://www.deter.com/unix/papers/nfs_trace.txt

[Hartman 92]

John Hartman

A talk on file append vs. overwrite ratios (Sides)

The results are derived from the same traces as the SOSP paper.

This talk was given to the LADDIS group on 1/21/92.

ftp://ftp.cs.berkeley.edu/ucb/sprite/papers/appendRatio.ps.Z

To bring

[Hartman 93]

John H. Hartman

Using the Sprite File System Traces

http://now.CS.Berkeley.EDU/Xfs/SpriteTraces/docs/sospTraces.ps.Z

sospTraces.ps.gz

[Roselli 96]

Tom Anderson, Mike Dahlin, Jeanna Neefe, Drew Roselli, Randy Wang

File System Tracing (Slides)

xFStraceSlides.ps.gz

AuspexTraces

Auxpex File System Traces

http://now.CS.Berkeley.EDU/Xfs/AuspexTraces/auspex.html

SpriteTraces

Sprite Traces

http://now.CS.Berkeley.EDU/Xfs/SpriteTraces/sprite_traces.html

Simulation

[Thekkath 92]

Chandramohan A. Thekkath, John Wilkes and Edward D. Lazowska

Techniques for File System Simulation

SPE 24(11), 981-999 (November 1994)

http://columbus.cs.nott.ac.uk/cgi-bin/getpaper?paper=spe922ct.pdf

spe922.ct.pdf.gz

[Ruemmler 94]

Chris Ruemmler and John Wilkes

An introduction to disk drive modeling

IEEE Computer 27(3):17-29, March 1994.

(html) http://almond.srv.cs.cmu.edu/....../HTML-Papers/DiskModeling/i.html

http://www.hpl.hp.com/personal/John_Wilkes/papers/IEEEComputer.DiskModel.ps.Z

IEEEComputer.DiskModel.ps.gz

Performance

[Seltzer 93]: Seltzer, M.; File System Performance and Transaction Support.; Computer Science Department, Computer Science Division, UCB/ERL M92.; http://www.eecs.harvard.edu/~margo/papers/thesis.ps.gz; Seltzer93.ps.gz
[Smith 94]: Keith Smith, Margo Seltzer; File Layout and File System Performance; Harvard Computer Science Technical Report TR-35-94; http://www.eecs.harvard.edu/~keith/papers/tr94.ps.gz; tr94.ps.gz
[Seltzer 95]: Margo Seltzer, Keith A. Smith, Hari Balakrishnan, Jacqueline Chang, Sara McMains, Venkata Padmanabhan; File System Logging Versus Clustering: A Performance Comparison; Proceedings of the 1995 USENIX Technical Conference; http://www.das.harvard.edu/users/faculty/Margo_Seltzer/papers/usenix.195.ps.gz; usenix.195.ps.gz
[Howard 88]: John H. Howard, Michael L. Kazar, Sherri G. Menees, DAvid A. Nichols, M. Satyanarayanan, Robert N. Sidebotham, Michel J. West; Scale and Performance in a Distributed File System; ACM Transaction on Computer Ssstems. February 1988; http://das-www.harvard.edu/cs/academics/courses/cs261/readings/howard-1988.html; http://das-www.harvard.edu/cs/academics/courses/cs261/readings/howard-1988.ps.gz; howard-1988.ps.gz
[Ganger 94]: Gregory R. Ganger and Yale N. Patt; Metadata Update Performance in File Systems; USENIX Symposium on Operating Systems Design and Implementation, pp. 49-60 (1994); http://www.citi.umich.edu/u/cja/598/papers.cja/ganger94osdi.ps; To bring

Distributed Caching

[Dahlin 94]: Michael Dahlin, Randolph Wang, Thomas Anderson, and David Patterson; Cooperative Caching: Using Remote Client Memory to Improve File System Performance; OSDI 1994; http://now.CS.Berkeley.EDU/~dahlin/papers/osdiDraft.ps; osdi.ps.gz
[Cortes 95]: Toni Cortes, Sergi Girona, Jesus Labarta; PACA: A Distributed File System Cache for Parallel Machines. Performance under Unix-like workload; Report number: UPC-CEPBA-1995-13; Keywords: PACA, Parallel File System, File Cache, File Prefetching, N-Chance Forwarding LRU-Interleaved, Cooperative Caching; Abstract:> Parallel computers have a great computing power while I/O performance is far behind and it is, very often, the machine bottleneck. In this paper we tackle this problem presenting PACA, a cache directed file system aimed at parallel machines which run both Unix-like and parallel applications. PACA is a specific cooperative caching mechanism that defines a parallel global cache from all nodes local caches. Simplicity, scalability and performance are the main objectives in the design. We also present performance figures under Unix-like workload and compare them with other parallel/distributed caches already implemented.; ftp://gaudi.ac.upc.es/pub/reports/CEPBA/1995/UPC-CEPBA-1995-13.ps.Z; PACA.ps.gz
[Muntz 94]: Daniel Alan Muntz,; Multilevel Caching in Distributed File Systems; Doctoral Thesis, The University of Michigan (1994).; http://www.citi.umich.edu/u/cja/598/papers.cja/dmuntz94thesis.ps; dmuntz94thesis.ps.gz
[Nelson 88]: Michael N. Nelson, Brent B. Welch, John K. Ousterhout; Caching in the Sprite Network File System; ACM Transactions on Computer Systems vol.6, no. 1 (Feb. 1988) pp. 134-154.; (review) http://www.acm.org:82/pubs/toc/Abstracts/0734-2071/42183.html; (ocr) ftp://tr-ftp.cs.berkeley.edu/pub/tech-reports/csd/csd-87-345/; ftp://ftp.cs.berkeley.edu/ucb/sprite/papers/caching.ps; caching.ps.gz

Distributed Shared Memory

[Grunwald 94]: Dirk Grunwald, and Suvas Vajracharya; Efficient Barriers for Distributed Shared Memory Computers; 8th Intl Symp on Parallel Processing , , Apri 1994.; http://www.cs.colorado.edu/homes/grunwald/public_html/IPPS94-short-barrier.ps; Efficient_DSM.ps.gz
[Nitzberg 91]: Bill Nitzberg, Virginia Lo.; Distributed Shared Memory: A Survey of Issues and Algorithms; IEEE Computer August 1991; URL not known

Distributed File Systems

[Welch 94]: Brent Welch; A Comparison of Three Distributed File System Architectures: Vnode, Sprite, and Plan 9; Computing Systems, Vol. 7(2), pp. 175-199 (1994); ftp://parcftp.xerox.com/pub/sprite/welch/compsys2.ps

RAIDs

[McLean 91]: Pete McLean; An Introduction to RAID: Redundant Arrays of Inexpensive Disks; Digital Equipment Corporation; raid-paper.ps.gz
[Chen 95]: Peter M. Chen, Edward K. Lee; Striping in a RAID Level 5 Disk Array; Proceedings of the 1995 ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems; raid5stripe.ps.gz
[Courtright 94]: William V. Courtright II, Garth A. Gibson; Backward Error Recovery in Redundant Disk Arrays; http://parsys.cs.cmu.edu/afs/cs/Web/Groups/PDL/ftp/RAID/CMG94paper.ps; CMG94paper.ps.gz

Parallel I/O

[Corbett 95]: P. Corbett, D. Feitelson, S. Fineberg, Y. Hsu, B. Nitzberg, J. Prost, M. Snir, B. Traversat, and P. Wong,; Overview of the MPI-IO Parallel I/O Interface; Third Workshop on I/O in Parallel and Distributed Systems, IPPS '95, Santa Barbara, CA, pp. 1-15, April 25, 1995.; http://lovelace.nas.nasa.gov/MPI-IO/iopads95-paper.ps; iopads95-paper.ps.gz
[MPI-IO 95]: P. Corbett, Y. Hsu, J. Prost, M. Snir, S. Fineberg, B. Nitzberg, B. Traversat, P. Wong and D. Feitelson; MPI-IO: A Parallel File I/O Interface for MPI Version 0.4; 1995; mpi-io-report.0.4.ps.gz
[Feitelson 95]: Drog G. Feitelson, Peter F. Corbett, Sandra Johnson Baylor , Yarsun Hsu; Parallel I/O Subsystems in Massively Parallel Supercomputers; IEEE Parallel & Distributed Technology 3(3), pp. 33-47, Fall 1995.; (abstract) http://www.computer.org/pubs/p&dt/abs95.htm#pdfa95Feitelson; URL not known

File Systems Ideas

[de Jonge 93]: Wiebren de Jonge, M. Frans Kaashoek, and Wilson C. Hsieh.; The Logical Disk: A New Approach to Improving File Systems; Appears in Proceedings of the Thirteenth Symposium on Operating Systems Principles, 1993.; http://www.pdos.lcs.mit.edu/ld/LogicalDisk.ps; LogicalDisk.ps.gz
[Grimm 96]: Robert Grimm, Wilson C. Hsieh, Wiebren de Jonge, and M. Frans Kaashoek.; Atomic Recovery Units: Failure Atomicity for Logical Disks.; Computing Systems, Hong Kong, May 1996.; http://www.pdos.lcs.mit.edu/ld/arus.ps; arus.ps.gz
[Anderson 96]: Ross J. Anderson; The Eternity Service; ftp://ftp.cl.cam.ac.uk/users/rja14/eternity.ps.Z; eternity.ps.gz
[Bosch 96]: Peter Bosch, Sape J. Mullender; Cut-and-Paste file-systems: integrating simulators and file-systems; January 1996, Winter '96 USENIX Conference proceedings, San Diego CA; ftp://ftp.pegasus.esprit.ec.org/pub/peterb/CutPasteFileSystem.ps.gz

Cleaning and Allocation Polices

[Blackwell 95]: Trevor Blackwell, Jeffrey Harris, Margo I. Seltzer; Heuristic Cleaning Algorithms in Log-Structured File Systems; USENIX Winter 1995: 277-288; Abstract: http://das-www.harvard.edu/users/students/Trevor_Blackwell/Usenix95.html; http://www.eecs.harvard.edu/~tlb/usenixw95.ps; usenixw95.ps.gz
[Smith 96]: Smith, K., Seltzer, M.; A Comparison of FFS Disk Allocation Polices; Proceedings of the 1996 Usenix Technical Conference, San Diego, CA January 1996.; http://www.cs.washington.edu/homes/ericc/lfs/ffs_disk_policies.ps; ffs_disk_policies.ps.gz
[ Ruffin 94]: Michel Ruffin; Issues in Logging Techniques through a Study of Four Systems; Univ. of Glasgow (UK), FIDE2 report 94/89.; http://www-sor.inria.fr/~ruffin/papers/Logging_techniques:cs.ps.gz; Logging_techniques_cs.ps.gz

Log-structured File Systems

[Ousterhout 89]: John Ousterhout and Fred Douglis,; Beating the I/O Bottleneck: A Case for Log-Structured File Systems,; in Operating Systems Review Vol. 23(1), pp. 11-28 (January, 1989).; ftp://ftp.cs.berkeley.edu/ucb/sprite/papers/lfs-case.ps; lfs-case.ps.gz
[Ousterhout 90]: John K. Ousterhout; Why Aren't Operating Systems Getting Faster as Fast as Hardware?; USENIX Summer 1990; ftp://ftp.cs.berkeley.edu/ucb/sprite/papers/os-benchmark.ps; os-benchmark.ps.gz
[Rosenblum 90]: Mendel Rosenblum and John K.Ousterhout; The LFS Storage Manager; USENIX Summer'90 Conference Proceeding, p315-324 Jun 1990; lfs-storage.ps.gz
[Anderson 95]: T. Anderson, M. Dahlin, J. Neefe, D. Patterson, D. Roselli, R. Wang; Serverless Network File Systems; 15th Symposium on Operating Systems Principles, ACM Transactions on Computer Systems 1995; http://now.CS.Berkeley.EDU/Papers/Papers/sosp95.ps; sosp95.ps.gz
[Kohl 93]: John T.Kohl, Carl Staelin, Micheal Stonebraker; HighLight: Using a Log-structured File System for Tertiary Storage Management; USENIX Winter'93 Conference Proceeding, p435-447; ftp://s2k-ftp.cs.berkeley.edu/pub/tech-reports/s2k/s2k-92-16/s2k-92-16.ps; Kohl93.ps.gz
[Seltzer 93]: Seltzer M., Bostic K., McKusick M., Staelin C.; A Log-Structured File System for UNIX; Proceedings of the 1993 Winter Usenix Conference.; http://www.eecs.harvard.edu/~margo/papers/usenix.193.ps.gz; lfs_for_unix.ps.gz
[Rosenblum 92]: Mendel Rosenblum; The Design and Implementation of a Log-structured File System; Pd Thesis; ftp://ftp.cs.berkeley.edu/ucb/sprite/papers/thesis-Rosenblum.ps; thesis-Rosenblum.ps.gz
[Rosenblum 91]: Mendel Rosenblum and John K. Ousterhout; The Design and Implementation of a Log-Structured File System; Proceedings of the 13th ACM Symposium on Operating Systems Principles, October 1991; Describes a Log-Structured File System that makes all writes to disk sequential. Discusses efficient ways to clean the disk to prevent excessive fragmentation.; ftp://ftp.cs.berkeley.edu/ucb/sprite/papers/lfsSOSP91.ps; lfsSOSP91.ps.gz
[Chilimbi 92]: Chilimbi, Myllymaki, Weiss, C.; Experiences with Implementing a Log-Structured File System; http://www.cs.washington.edu/homes/ericc/lfs/lfs_implementation.ps; lfs_implementation.ps.gz
[Seltzer 95]: Margo L. Seltzer; Clustering, Logging and Journaling: Aproaches to High Performance File System Desing; http://www.eecs.harvard.edu/~margo/slides/mar17.95.ps.gz; mar17.95.ps.gz
[Hulse 96]: David Hulse, Alan Dearle; A Log-Structured Persistent Store; Conferences 96; Abstract http://www.cs.mu.oz.au/conferences96/abstracts/acsc.9b.1.html; http://nezz.cs.stir.ac.uk/~dave/GH-14.pdf; GH-14.pdf.gz
[Shirriff XX]: Ken Shirriff; The Sawmill logging file system; ftp://ftp.cs.berkeley.edu/ucb/sprite/papers/sawmill.ps; saqmill.ps.gz
[Chutani 92]: Sailesh Chutani, Owen T. Anderson, Michael L. Kazar, Bruce W. Leverett, W. Anthony Mason, and Robert N. Sidebotham; The Episode File System; Proc. 1992 Winter USENIX Conf., pp. 43-60 (1992); http://www.citi.umich.edu/u/cja/598/papers.honey.W92/episode.PS; To bring
[Satyanarayanan 92]: Satyanarayanan, M., Kistler, J.J., Kumar, P., Mashburn, H.; On the Ubiquity of Logging in Distributed File Systems; Third IEEE Workshop on Workstation Operating Systems Apr. 1992, Key Biscayne, FL; http://www.cs.cmu.edu/afs/cs/project/coda/Web/docdir/wwos3.ps.Z; wwos3.ps.gz
[Bosch 93]: Peter Bosch, Sape Mullender and Tage Stabell-Kulø; Huygens File Service: Storage Architecture; November 1993, Pegasus paper 93-3; http://www.pegasus.esprit.ec.org/papers/paper93-03.ps
[Neefe 97]: Jeanna Neefe Matthews, Drew Roselli, Adam M. Costello, Randolph Y. Wang and Thomas E. Anderson; Improving the Performance of Log-Structured File Systems with Adaptive Methods; Sixteenth ACM Symposium on Operating System Principles, Oct. 1997, Saint Malo, France; http://www.cs.berkeley.edu/~neefe/papers/sosp97/sosp97.ps; sosp97.ps.gz

New Entries to be processed.

[Xxxx 99]: Author, author; Title tile; Date date; URL; Local copy