Semantic file systems

ABSTRACT

A semantic file system is an information storage system that provides flexible associative access to the system's contents by automatically extracting attributes from files with file type specific transducers. Associative access is provided by a conservative extension to existing tree-structured file system protocols, and by protocols that are designed specifically for content based access. Compatiblity with existing file system protocols is provided by introducing the concept of a virtual directory. Virtual directory names are interpreted as queries, and thus provide flexible associative access to files and directories in a manner compatible with existing software. Rapid attribute-based access to file system contents is implemented by automatic extraction and indexing of key properties of file system objects. The automatic indexing of files and directories is called "semantic" because user programmable transducers use information about the semantics of updated file system objects to extract the properties for indexing. Experimental results from a semantic file system implementation support the thesis that semantic file systems present a more effective storage abstraction than do traditional tree structured file systems for information sharing and command level programming.

REFERENCES

• BP88: Brian N. Bershad and C. Brian Pinkerton. Watchdogs: extending the UNIX file system. In USENIX Association 1988 Winter Conference Proceedings, Dallas, Texas, February 1988.
• Cat83: R.G.G. Cattell. Design and Implementation of a Relationship-Entity-Datum Data Model. Technical Report CSL-83-4, Xerox PARC, Palo Alto, California, May 1983.
• CCI88: CCITT. The Directory- Overview of Concepts, Models and Services. Recommendation X.500, 1988.
• CG91: Vincent Cate , Thomas Gross, Combining the concepts of compression and caching for a two-level filesystem, Proceedings of the fourth international conference on Architectural support for programming languages and operating systems, p.200-211, April 08-11, 1991, Santa Clara, California, United States
• CL89: Brent Callaghan and Tom Lyon. The automounter. In USENIX Association 1989 Winter Con/erence Proceedings, 1989.
• Cla90: Claris Corporation, Santa Clara, California, January 1990. News Release.
• Cor: Lotus Corporation. Lotus Magellan: Quick Launch. Product tutorial, Lotus Corporation, Cambridge, Massachusetts. Part number 35115.
• DANO91: Peter B. Danzig, Jongsuk Ahn, John Noll, and Katia Obraczka. Distributed Indexing: A Scalable Mechanism/or Distributed In/ormation Retrieval. Technical Report USC-TR 91-06, University of Souther California, Computer Science Department, 1991.
• GCS87: D. K. Gifford , R. G. Cote , D. A. Segal, WALTER USER''S MANUAL (VERSION 1.0), Massachusetts Institute of Technology, Cambridge, MA, 1987
• GLB85: David K. Gifford , Robert W. Baldwin , Stephen T. Berlin , John M. Lucassen, An architecture for large scale information systems, Proceedings of the tenth ACM symposium on Operating systems principles, p.161-170, December 1985, Orcas Island, Washington, United States
• GMT86: Ferdinando Gallo , Regis Minot , Ian Thomas, The object management system of PCTE as a software engineering database management system, Proceedings of the second ACM SIGSOFT/SIGPLAN software engineering symposium on Practical software development environments, p.12-15, December 09-11, 1986, Palo Alto, California, United States
• GO91: David K. Gifford , James O'Toole, Intelligent File Systems for Object Repositories, Proceedings of the International Workshop on Operating Systems of the 90s and Beyond, p.20-24, July 08-12, 1991
• Gro86: Computer Systems Research Group. UNIX User's Reference Manual. 4.3 Berkeley Software Distribution, Berkeley, California, April 1986. Virtu al VAX- 11 Version.
• Inf90: Information Dimensions, Inc. BASISplus. The Key To Managing The World Of Information. Information Dimensions, Inc., Dublin, Ohio, 1990. Product description.
• Kaz88: Michael Leon Kazar. Synchronization and caching issues in the Andrew File System. In USENIX Association 1988 Winter Con/erence Proceedings, pages 31-43, 1988.
• Ki184: T.J. Killian. Processes as files. In USENIX Association 1984{ Summer Con/erence Proceedings, Salt Lake City, Utah, 1984.
• Kle86: S.R. Kleiman. Vnodes: an architecture for multiple file system types in Sun UNIX. in USENIX Association 1986 Winter Conference Proceedings, pages 238-247, 1986.
• KM91: Brewster Kahle and Art Medlar. An In/ormation System/or Corporate Users: Wide Area In- /ormation Servers. Technical Report TMC-199, Thinking Machines, Inc., April 1991. Version 3.
• Leg89: Legato Systems, Inc. Nhfsstone. Software package. Legato Systems, Inc., Palo Alto, California, 1989.
• Les: M.E. Lesk. Some applications of inverted indexes on the UNIX system. UNIX Supplementary Document, Section 30.
• Log91: Boss Logic, Inc. Boss DMS development specification. Technical documentation, Boss Logic, Inc., Fairfield, IA, February 1991.
• Mog86: Jeffrey C Mogull, Representing information about files, Stanford University, Stanford, CA, 1986
• NC89a: NeXT Corporation. 1.0 release notes: indexing. NeXT Corporation, Palo Alto, California, 1989.
• NC89b: NeXT Corporation. Text indexing facilities on the NeXT computer. NeXT Corporation, Palo Alto, California, 1989. from 1.0 Release Notes.
• Nee91: Roger Needham. 1991. Personal communication.
• Neu90: Barry Clifford Neuman, The virtual system model: a scalable approach to organizing large systems, University of Washington, Seattle, WA, 1992
• NIS91: Ansi z39.50 version 2. National Information Standards Organization, Bethesda, Maryland, January 1991. Second Draft.
• OCH*85: John K. Ousterhout , Hervé Da Costa , David Harrison , John A. Kunze , Mike Kupfer , James G. Thompson, A trace-driven analysis of the UNIX 4.2 BSD file system, Proceedings of the tenth ACM symposium on Operating systems principles, p.15-24, December 1985, Orcas Island, Washington, United States
• Pen90: Jan-Simon Pendry. Amd an automounter. Department of Computing, Imperial College, London, May 1990.
• Pet88: Larry L. Peterson, The profile naming service, ACM Transactions on Computer Systems (TOCS), v.6 n.4, p.341-364, Nov. 1988 [doi>10.1145/48012.48013]
• PPTT90: Rob Pike, Dave Presotto, Ken Thompson, and Howard Trickey. Plan 9 from Bell Labs. UK UUG proceedings, 1990.
• PW90: Jan-Simon Pendry and Nick Williams. Amd: the 4.4 BSD automounter reference manual. December 1990. Documentation for software revision 5.:t Alpha.
• Roc85: Marc J. Rochkind, Advanced UNIX programming, Prentice-Hall, Inc., Upper Saddle River, NJ, 1985
• RT74: Dennis M. Ritchie , Ken Thompson, The UNIX time-sharing system, Communications of the ACM, v.17 n.7, p.365-375, July 1974 [doi>10.1145/361011.361061]
• Sal83: Gerard Salton , Michael J. McGill, Introduction to Modern Information Retrieval, McGraw-Hill, Inc., New York, NY, 1986
• SC88: Sun Corporation. The Network Software Environment. Technical Report, Sun Computer Corporation, Mountain View, California, 1988.
• Sch89: Michael F. Schwartz. The Networked Resource Discovery Project. In Proceedings o/the IFIP XI World Congress, pages 827-832, IFIP, August 1989.
• SGK*85: R. Sandberg, D. Goldberg, S. Kleiman, D. Walsh, and B. Lyon. Design and implementation of the Sun Network Filesystem. In USENIX Association 1985 Summer Conference Proceedings, pages 119-130, 1985.
• SK86: Craig Stanfill , Brewster Kahle, Parallel free-text search on the connection machine system, Communications of the ACM, v.29 n.12, p.1229-1239, Dec. 1986 [doi>10.1145/7902.7907]
• Sta87: Richard M. Stallman, GNU EMACS Manual, iUniverse, Incorporated, 2000
• Ste91: Richard Marlon Stein, Browsing through terabytes, BYTE, v.16 n.5, p.157-164, May 1991
• Sun88: Network Pro#ramming. Sun Microsystems, Sunnyvale, California, May 1988. Part Number 800- 1779-10.
• Sun89: NFS: network file system protocol specification. Sun Microsystems, Network Working Group, Request for Comments (RFC 1094), March 1989. Version 2.
• Tec90: ON Technology. ON Technology, Inc. announces On Location for the Apple Macintosh computer. News Release ON Technology, inc., Cambridge, Massachusetts, January 1990.
• Ver90: Verity. Topic. Product description, Verity, Mountain View, California, 1990.
• Wei: Peter Weinberger. CBT Program documentation. Bell Laboratories.
• WO88: Brent B. Welch and John K. Ousterhout. Pseudo devices: user-level extensions to the Sprite file system. In USENIX Association 1988 Summer Conference Proceedings, San Francisco, California, June 1988.

INDEX TERMS

Primary Classification:
  D. Software
  D.4 OPERATING SYSTEMS
      D.4.3 File Systems Management
          Subjects: Directory structures

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Indexing methods
      H.3.3 Information Search and Retrieval
          Subjects: Retrieval models

General Terms:
Algorithms, Design