K42: an infrastructure for operating system research

ABSTRACT

K42 is an open-source scalable research operating system well suited to support systems research. The primary goals of K42's design that support such research include flexibility to allow a multitude of policies and implementations to be supported simultaneously, extensibility to allow new policies and implementations to be readily added, and scalability to enable good performance for both small and large applications on both small and large multiprocessor systems. The goals are accomplished via key features including an object-oriented structure that allows specialized resource management implementations and policies on a per-resource, per-application basis, implementation in user-level servers of much of the system functionality, and a sophisticated set of underlying services that provides a programming model for developing system software in a scalable and modular fashion.These characteristics make K42 an attractive framework for prototyping new operating system ideas. In addition, K42 has a sophisticated performance monitoring infrastructure allowing a thorough understanding of new ideas to be gained. The above framework combined with a consistent emphasis on scalability makes K42 well suited for high-end computing initiatives. In this paper, we describe the structure of K42 which contributes to the advantageous prototyping environment, and demonstrate how to utilize it by describing ongoing research efforts.

REFERENCES

• 1: Linux VServer Project. http://linux-vserver.org/.
• 2: Report from the 4th FAST-OS (forum to address scalable technologies for runtime and operating systems) workshop. http://www.cs.unm.edu/ fastos/03workshop/report.pdf, July 2003.
• 3: Eric Allen, David Chase, Victor Luschangco, Jan-Willem Maessen, Sukyoung Ryu, Guy L. Steele Jr., and Sam Tobin-Hochstadt. The Fortress language specification (version 0.785). Sun Microsystems, Inc., November 2005.
• 4: Thomas E. Anderson , Brian N. Bershad , Edward D. Lazowska , Henry M. Levy, Scheduler activations: effective kernel support for the user-level management of parallelism, ACM Transactions on Computer Systems (TOCS), v.10 n.1, p.53-79, Feb. 1992 [doi>10.1145/146941.146944]
• 5: Jonathan Appavoo, Marc Auslander, David Edelsohn, Dilma da Silva, Orran Krieger, Michal Ostrowski, Bryan Rosenburg, Robert W. Wisniewski, and Jimi Xenidis. Providing a Linux API on the scalable K42 kernel. In Freenix track, USENIX Technical Conference, pages 323--336, San Antonio, TX, June 9--14 2003.
• 6: Jonathan Appavoo , Kevin Hui , Michael Stumm , Robert W. Wisniewski , Dilma Da Silva , Orran Krieger , Craig A. N. Soules, An infrastructure for multiprocessor run-time adaptation, Proceedings of the first workshop on Self-healing systems, November 18-19, 2002, Charleston, South Carolina [doi>10.1145/582128.582130]
• 7: Gaurav Banga , Peter Druschel , Jeffrey C. Mogul, Resource containers: a new facility for resource management in server systems, Proceedings of the third symposium on Operating systems design and implementation, p.45-58, February 1999, New Orleans, Louisiana, United States
• 8: Andrew Baumann, Jonathan Appavoo, Dilma da Silva, Orran Krieger, and Robert W. Wisniewski. Improving operating system availability with dynamic update. In Workshop of Operating System and Architectural Support for the On-demand IT Infrastructure (OASIS), pages 21--27, Boston Massachusetts, October 9, 2004 2004.
• 9: Andrew Baumann, Jonathan Appavoo, Dilma Da Silva, Jeremy Kerr, Orran Krieger, and Robert W. Wisniewski. Providing dynamic update in an operating system. In USENIX Technical Conference, pages 279--291, Anaheim, CA, April 2005.
• 10: Andrew Baumann, Jeremy Kerr, Jonathan Appavoo, Dilma Da Silva, Orran Krieger, and Robert W. Wisniewski. Module hot-swapping for dynamic update and reconfiguration in K42. In Proc. of 6th Linux.conf.au (LCA), Canberra, April 2005.
• 11: B. N. Bershad , S. Savage , P. Pardyak , E. G. Sirer , M. E. Fiuczynski , D. Becker , C. Chambers , S. Eggers, Extensibility safety and performance in the SPIN operating system, Proceedings of the fifteenth ACM symposium on Operating systems principles, p.267-283, December 03-06, 1995, Copper Mountain, Colorado, United States
• 12: Patrick Bohrer , James Peterson , Mootaz Elnozahy , Ram Rajamony , Ahmed Gheith , Ron Rockhold , Charles Lefurgy , Hazim Shafi , Tarun Nakra , Rick Simpson , Evan Speight , Kartik Sudeep , Eric Van Hensbergen , Lixin Zhang, Mambo: a full system simulator for the PowerPC architecture, ACM SIGMETRICS Performance Evaluation Review, v.31 n.4, p.8-12, March 2004 [doi>10.1145/1054907.1054910]
• 13: Angela Demke Brown , Todd C. Mowry , Orran Krieger, Compiler-based I/O prefetching for out-of-core applications, ACM Transactions on Computer Systems (TOCS), v.19 n.2, p.111-170, May 2001 [doi>10.1145/377769.377774]
• 14: Ray Bryant, John Hawkes, and Jack Steiner. Scaling Linux to the extreme: from 64 to 512 processors. In Ottawa Linux Symposium. Linux Symposium, 2004.
• 15: Brad Chamberlain. An introduction to Chapel: Cray Cascade's High Productivity Language. In AHPCRC DARPA Parallel Global Address Space (PGAS) Programming Models Conference, Minneapolis, MN, September 2005.
• 16: Philippe Charles , Christian Grothoff , Vijay Saraswat , Christopher Donawa , Allan Kielstra , Kemal Ebcioglu , Christoph von Praun , Vivek Sarkar, X10: an object-oriented approach to non-uniform cluster computing, Proceedings of the 20th annual ACM SIGPLAN conference on Object oriented programming, systems, languages, and applications, October 16-20, 2005, San Diego, CA, USA
• 17: Dilma da Silva, Livio Soares, and Orran Krieger. KFS: Exploring flexilibity in file system design. In Proc. of the Brazilian Workshop in Operating Systems, Salvador, Brazil, August 2004.
• 18: Francis Dang, Maria Jesus Garzaran, Milos Prvulovic, Ye Zhang, Alin Jula, Hao Yu, Nancy Amato, Lawrence Rauchwerger, and Josep Torrellas. Smartapps: An application centric approach to high performance computing: Compiler-assisted software and hardware support for reduction operations. In Proc. Next Generation Software Workshop, pages 10--19, Fort Lauderdale, Florida, April 2002.
• 19: D. R. Engler , M. F. Kaashoek , J. O'Toole, Jr., Exokernel: an operating system architecture for application-level resource management, Proceedings of the fifteenth ACM symposium on Operating systems principles, p.251-266, December 03-06, 1995, Copper Mountain, Colorado, United States
• 20: Marc E. Fiuczynski, Robert Grimm, Yvonne Coady, and David Walker. Patch (1) considered harmful. In Proceedings of the 10th Workshop on Hot Topics in Operating Systems (HotOS), Santa Fe, NM, June 2005. USENIX.
• 21: Ben Gamsa , Orran Krieger , Jonathan Appavoo , Michael Stumm, Tornado: maximizing locality and concurrency in a shared memory multiprocessor operating system, Proceedings of the third symposium on Operating systems design and implementation, p.87-100, February 1999, New Orleans, Louisiana, United States
• 22: Gregory R. Ganger , Dawson R. Engler , M. Frans Kaashoek , Hector M. Briceño , Russell Hunt , Thomas Pinckney, Fast and flexible application-level networking on exokernel systems, ACM Transactions on Computer Systems (TOCS), v.20 n.1, p.49-83, February 2002 [doi>10.1145/505452.505455]
• 23: Gideon Glass , Pei Cao, Adaptive page replacement based on memory reference behavior, Proceedings of the 1997 ACM SIGMETRICS international conference on Measurement and modeling of computer systems, p.115-126, June 15-18, 1997, Seattle, Washington, United States
• 24: Jeffrey Katcher. Postmark: A new file system benchmark. Technical Report TR3022, Network Appliance.
• 25: Jong Min Kim, Jongmoo Choi, Jesung Kim, Sam H. Noh, Sang Lyul Min, Yookun Cho, and Chong Sang Kim. A low-overhead high-performance unified buffer management scheme that exploits sequential and looping references. In Symposium on Operating Systems Design and Implementation, pages 119--134. USENIX Association, 23--25 October 2000.
• 26: Steve R. Kleiman. Vnodes: An architecture for multiple file system types in Sun UNIX. In Proceedings of 1986 Summer USENIX Annual Technical Conference, pages 238--247, Atlanta, GA, USA, 1986.
• 27: Orran Krieger, Marc Auslander, Bryan Rosenburg, Robert W. Wisniewski, Jimi Xenidis, Dilma Da Silva, Michal Ostrowski, Jonathan Appavoo, Maria Butrico, Mark Mergen, Amos Waterland, and Volkmar Uhlig. K42: Building a real operating system. In To Appear in the Proceedings of Eurosys'2006. ACM SIGOPS, April 2006.
• 28: Orran Krieger , Michael Stumm, HFS: a performance-oriented flexible file system based on building-block compositions, ACM Transactions on Computer Systems (TOCS), v.15 n.3, p.286-321, Aug. 1997 [doi>10.1145/263326.263356]
• 29: Paul E. McKenney, Dipankar Sarma, Andrea Arcangeli, Andi Kleen, Orran Krieger, and Rusty Russell. Read copy update. In Proceedings of the Ottawa Linux Symposium (OLS), pages 338--367, 26--29 June 2002.
• 30: Rodney Van Meter and Minxi Gao. Latency management in storage systems. In Symposium on Operating Systems Design and Implementation, pages 103--117. USENIX Association, 23--25 October 2000.
• 31: Jeff Mogul. Operating systems should support business change. In Proceedings of the 10th Workshop on Hot Topics in Operating Systems (HotOS), Santa Fe, NM, June 2005. USENIX.
• 32: David Mosberger , Larry L. Peterson, Making paths explicit in the Scout operating system, Proceedings of the second USENIX symposium on Operating systems design and implementation, p.153-167, October 29-November 01, 1996, Seattle, Washington, United States
• 33: C. Pu , T. Autrey , A. Black , C. Consel , C. Cowan , J. Inouye , L. Kethana , J. Walpole , K. Zhang, Optimistic incremental specialization: streamlining a commercial operating system, Proceedings of the fifteenth ACM symposium on Operating systems principles, p.314-321, December 03-06, 1995, Copper Mountain, Colorado, United States
• 34: ReiserFS home page, April 2002. http://www.namesys.com.
• 35: Margo Seltzer, Yasuhiro Endo, Christopher Small, and Keith A. Smith. An introduction to the architecture of the VINO kernel. Technical report, Harvard University, 1994.
• 36: Craig A. N. Soules, Jonathan Appavoo, Kevin Hui, Robert W. Wisniewski, Dilma da Silva, Gregory R. Ganger, Orran Krieger, Michael Stumm, Marc Auslander, Michal Ostrowski, Bryan Rosenburg, and Jimi Xenidis. System support for online reconfiguration. In USENIX Technical Conference, pages 141--154, San Antonio, TX, June 9--14 2003.
• 37: Michael M. Swift, Muthukaruppan Annamalai, Brian N. Bershad, and Henry M. Levy. Recovering device drivers. In Procedings of the 6th ACM/USENIX ymposium on Operating Systems Design and Implementation (OSDI), pages 1--16, San Francisco, CA, December 2004. USENIX.
• 38: David Tam. Performance analysis and optimization of the Hurricane File System. Master's thesis, Department of Electrical and Computer Engineering, University of Toronto, Toronto, Ontario, Canada, January 2003.
• 39: Robert W. Wisniewski , Bryan Rosenburg, Efficient, Unified, and Scalable Performance Monitoring for Multiprocessor Operating Systems, Proceedings of the 2003 ACM/IEEE conference on Supercomputing, p.3, November 15-21, 2003

INDEX TERMS

Primary Classification:
  D. Software
  D.4 OPERATING SYSTEMS
      D.4.7 Organization and Design