Using a mobile phone for 6 DOF mesh editing

ABSTRACT

This paper describes how a mobile phone can be used as a six degree of freedom interaction device for 3D mesh editing. Using a video see-through Augmented Reality approach, the mobile phone meets several design guidelines for a natural, easy to learn, 3D human computer interaction device. We have developed a system that allows a user to select one or more vertices in an arbitrary sized polygon mesh and freely translate and rotate them by translating and rotating the device itself. The mesh is registered in 3D and viewed through the device and hence the system provides a unified perception-action space. We present the implementation details and discuss the possible advantages and disadvantages of this approach.

REFERENCES

• 1: Dzmitry Aliakseyeu , Sriram Subramanian , Jean-Bernard Martens , Matthias Rauterberg, Interaction techniques for navigation through and manipulation of 2D and 3D data, Proceedings of the workshop on Virtual environments 2002, May 30-31, 2002, Barcelona, Spain
• 2: Andel, M., Petrovski, A., Henrysson, A., Ollila, M. 2006. Interactive collaborative scene assembly using AR on mobile phones. In Proceedings of ICAT 2006 (to appear).
• 3: Martin Hachet , Joachim Pouderoux , Pascal Guitton, A camera-based interface for interaction with mobile handheld computers, Proceedings of the 2005 symposium on Interactive 3D graphics and games, April 03-06, 2005, Washington, District of Columbia [doi>10.1145/1053427.1053438]
• 4: Mika Hakkarainen , Charles Woodward, SymBall: camera driven table tennis for mobile phones, Proceedings of the 2005 ACM SIGCHI International Conference on Advances in computer entertainment technology, p.391-392, June 15-17, 2005, Valencia, Spain [doi>10.1145/1178477.1178565]
• 5: Thomas Riisgaard Hansen , Eva Eriksson , Andreas Lykke-Olesen, Mixed interaction space: designing for camera based interaction with mobile devices, CHI '05 extended abstracts on Human factors in computing systems, April 02-07, 2005, Portland, OR, USA [doi>10.1145/1056808.1057060]
• 6: Anders Henrysson , Mark Ollila, UMAR: Ubiquitous Mobile Augmented Reality, Proceedings of the 3rd international conference on Mobile and ubiquitous multimedia, p.41-45, October 27-29, 2004, College Park, Maryland [doi>10.1145/1052380.1052387]
• 7: Anders Henrysson , Mark Billinghurst , Mark Ollila, Face to Face Collaborative AR on Mobile Phones, Proceedings of the 4th IEEE/ACM International Symposium on Mixed and Augmented Reality, p.80-89, October 05-08, 2005 [doi>10.1109/ISMAR.2005.32]
• 8: Anders Henrysson , Mark Billinghurst , Mark Ollila, Virtual object manipulation using a mobile phone, Proceedings of the 2005 international conference on Augmented tele-existence, December 05-08, 2005, Christchurch, New Zealand [doi>10.1145/1152399.1152430]
• 9: Marble Revolution wesbite. http://www.bitside.com/entertainment/MOBILE%20GAMES/Marble
• 10: Mathias Mohring , Christian Lessig , Oliver Bimber, Video See-Through AR on Consumer Cell-Phones, Proceedings of the 3rd IEEE/ACM International Symposium on Mixed and Augmented Reality, p.252-253, November 02-05, 2004 [doi>10.1109/ISMAR.2004.63]
• 11: D. Mogilev , K. Kiyokawa , M. Billinghurst , J. Pair, AR Pad: an interface for face-to-face AR collaboration, CHI '02 extended abstracts on Human factors in computing systems, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/506443.506530]
• 12: Mosquito Hunt website:http://w4.siemens.de/en2/html/press/newsdesk_archive/2003/foe03111.html
• 13: Volker Paelke , Christian Reimann , Dirk Stichling, Foot-based mobile interaction with games, Proceedings of the 2004 ACM SIGCHI International Conference on Advances in computer entertainment technology, p.321-324, June 03-05, 2005, Singapore [doi>10.1145/1067343.1067390]
• 14: Rekimoto, J. 1996. Transvision: A Hand-held Augmented Reality System for Collaborative Design. In Virtual Systems and Multi-Media (VSMM)'96.
• 15: Rohs, M. 2004. Real-World Interaction with Camera Phones. In 2nd International Symposium on Ubiquitous Computing Sysmtes (UCS2004).
• 16: Ken Shoemake, ARCBALL: a user interface for specifying three-dimensional orientation using a mouse, Proceedings of the conference on Graphics interface '92, p.151-156, September 1992, Vancouver, British Columbia, Canada
• 17: Wagner, D., Pintaric, T., Ledermann, F., Schmalstieg, D. 2005. Towards Massively Multi-User Augmented Reality on Handheld Devices. In Third International Conference on Pervasive Computing (Pervasive 2005).
• 18: Shumin Zhai, User performance in relation to 3D input device design, ACM SIGGRAPH Computer Graphics, v.32 n.4, p.50-54, Nov. 1998 [doi>10.1145/307710.307728]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Keywords:
3D interfaces, content creation, mobile computer graphics, mobile phone augmented reality