skip to main content
10.1145/1174429.1174467acmconferencesArticle/Chapter ViewAbstractPublication PagesgraphiteConference Proceedingsconference-collections
Article

An interface for virtual 3D sculpting via physical proxy

Published: 29 November 2006 Publication History

Abstract

We explore the design space of using direct finger input in conjunction with a deformable physical prop for the creation and manipulation of conceptual 3D geometric models. The user sculpts virtual models by manipulating the space on, into, and around the physical prop, in an extension of the types of manipulations one would perform on traditional modeling media such as clay or foam. The prop acts as a proxy to the virtual model and hence as a frame of reference to the user's fingers. A prototype implementation uses camera-based motion tracking technology to track passive markers on the fingers and prop. The interface supports a variety of clay-like sculpting operations including deforming, smoothing, pasting, and extruding. All operations are performed using the unconstrained fingers, with command input enabled by a small set of finger gestures coupled with on-screen widgets.

References

[1]
Anderson, D., Yedidia, J., Frankel, J., Marks, J., Agarwala, A., Beardsley, P., Hodgins, J., Leigh, D., Ryall, K., & Sullivan, E. (2000). Tangible interaction + graphical interpretation: a new approach to 3D modeling. SIGGRAPH. p. 393--402.]]
[2]
Angelidis, A., Cani, M.-P., Wyvill, G., & King, S. (2004). Swirling-Sweepers: Constant-volume modeling. Pacific Graphics, p. 10--15.]]
[3]
Angelidis, A., Wyvill, G., & Cani, M.-P. (2004). Sweepers: Swept user-defined tools for modeling by deformation. Shape Modeling International, p. 63--73.]]
[4]
Barr, A. (1984). Global and local deformations of solid primitives. Computer Graphics, 18(3). p. 21--30.]]
[5]
Bourguignon, D., Chaine, R., Cani, M.-P., & Drettakis, G. (2004). Relief: A modeling by drawing tool. Eurographics Sketch-based Interfaces and Modeling, p. 151--160.]]
[6]
Cao, X. & Balakrishnan, R. (2003). VisionWand: interaction techniques for large displays using a passive wand tracked in 3D. UIST. p. 173--182.]]
[7]
Conner, B., Snibbe, S. S., Herndon, K. P., Robbins, D., Zeleznik, R., and Dam, A. v. (1992). Three dimensional widgets. Computer Graphics, 22(4). p. 121--129.]]
[8]
Deering, M. (1995). HoloSketch: a virtual reality sketching/animation tool. ACM TOCHI, 2(3). p. 220--238.]]
[9]
Desbrun, M., Meyer, M., Schroder, P., & Barr, A. (1999). Implicit fairing of irregular meshes using diffusion and curvature flow. SIGGRAPH. p. 317--324.]]
[10]
Dewaele, G. & Cani, M.-P. (2004). Interactive global and local deformations for virtual clay. Graphical Models, 66. p. 352--269.]]
[11]
Dewaele, G. & Cani, M.-P. (2004). Virtual clay for direct hand manipulation. Eurographics (Short Papers).]]
[12]
Ferley, E., Cani, M., & Gascuel, J. (2000). Practical volumetric scuplting. The Visual Computer, 16. p. 469--480.]]
[13]
Fitzmaurice, G., Ishii, FL, & Buxton, W. (1995). Bricks: Laying the foundations for graspable user interfaces. CHI. p. 442--449.]]
[14]
Freeman, W. & Weissman, C. (1995). Television control by hand gestures. International Workshop on Automatic Face and Gesture Recognition, p. 179--183.]]
[15]
Galyean, T. & Hughes, J. (1991). Sculpting: An interactive volume modeling technique. SIGGRAPH. p. 267--274.]]
[16]
Grossman, T., Balakrishnan, R., & Singh, K. (2003). An interface for creating and manipulating curves using a high degree-of-freedom input device. CHI. p. 185--192.]]
[17]
Grossman, T., Wigdor, D., & Balakrishnan, R. (2004). Multi finger gestural interaction with 3D volumetric displays. UIST. p. 61--70.]]
[18]
Guiard, Y. (1987). Asymmetric division of labor in human skilled bimanual action: The kinematic chain as a model. Journal of Motor Behavior, 19(4). p. 486--517.]]
[19]
Hinckley, K., Pausch, R., Goble, J., & Kassell, N. (1994). Passive real-world interface props for neurosurgical visualization. CHI. p. 452--458.]]
[20]
Igarashi, T. & Hughes, J. (2001). A suggestive interface for 3D drawing. UIST. p. 173--181.]]
[21]
Igarashi, T., Matsuoka, S., & Tanaka, H. (1999). Teddy: a sketching interface for 3D freeform design. SIGGRAPH. p. 409--416.]]
[22]
Ishii, H. & Ullmer, B. (1997). Tangible bits: towards seamless interfaces between people, bits and atoms. CHI. p. 234--241.]]
[23]
Ix, F., El-Sana, J., Qin, H., & Kaufman, A. (1999). Haptic sculpting of dynamic surfaces. ACM Symposium on Interactive 3D Graphics, p. 103--110.]]
[24]
Kobbelt, L., Campagna, S., Vorsatz, J., & Seidel, H. (1998). Interactive multiresolution modeling on arbitrary meshes. SIGGRAPH. p. 105--114.]]
[25]
Llamas, I., Kim, B., Gargus, J., Rossignac, J., & Shaw, C. D. (2003). Twister: a space-warp operator for the two-handed editing of 3D shapes. SIGGRAPH. p. 663--668.]]
[26]
McDonnell, K., Qin, H., & Wlodarczyk, R. (2001). Virtual clay: A real-time sculpting system with haptic toolkits. ACM Symposium on Interactive 3D Graphics, p. 179--190.]]
[27]
Molteni, M. (1992). The clay modeling handbook: Learning from the masters. NY: Clarkson Potter Publishers.]]
[28]
Nealen, A., Sorkine, O., Alexa, M., & Cohen-Or, D. (2005). A sketch-based interface for detail-preserving mesh editing. ACM Transactions on Graphics, 24(3). p. 1142--1147.]]
[29]
Nishmo, H., Utsumiya, K., & Korida, K. (1998). 3D object modeling using spatial and pictographic gestures. ACM Symp. on Virtual Reality Software and Technology, p. 51--58.]]
[30]
Pavlovic, V., Sharma, R., & Huang, T. (1997). Visual interpretation of hand gestures for human-computer interaction: A review. IEEE Trans PAMI, 19(7). p. 677--695.]]
[31]
Perry, R. & Frisken, S. (2001). Kizamu: a system for sculpting digital characters. SIGGRAPH. p. 47--56.]]
[32]
Piper, B., Ratti, C., & Ishii, H. (2002). Illuminating clay: A 3D tangible interface for landscape analysis. CHI. p. 355--362.]]
[33]
Ringel, M., Berg, H., Jin, Y., & Winograd, T. (2001). Barehands: implement-free interaction with a wall-mounted display. CHI Extended Abstracts, p. 367--368.]]
[34]
Rossignac, J., Allen, M., Book, W., Glezer, A., Ebert-Uphoff, I., Shaw, C., Rosen, D., Askins, S., Bai, J., Paul Bosscher, Gargus, J., Kim, B., Llamas, I., Nguyen, A., Yuan, G., & Zhu, H. (2003). Finger sculpting with digital clay: 3D shape input and output through a computer-controlled real surface. Shape Modeling International, p. 229.]]
[35]
Sachs, E., Roberts, A., & Stoops, D. (1991). 3-draw: A tool for designing 3D shapes. IEEE Computer Graphics and Applications, 11(6). p. 18--26.]]
[36]
Schkolne, S., Pruett, M., & Schroeder, P. (2001). Surface drawing: Creating organic 3D shapes with the hand and tangible tools. CHI. p. 261--268.]]
[37]
Sederberg, T. & Parry, S. (1986). Free-form deformation of solid geometric models. SIGGRAPH. p. 151--160.]]
[38]
Segen, J. & Kumar, S. (1998). Gesture VR: Vision-based 3D hand interface for spatial interaction. Multimedia, p. 455--464.]]
[39]
Shaw, C. & Green, M. (1994). Two handed polygonal surface design. UIST. p. 205--212.]]
[40]
Tsang, S., Balakrishnan, R., Singh, K., & Ranjan, A. (2004). A suggestive interface for image guided 3D sketching. CHI. p. 591--598.]]
[41]
Wang, S. & Kaufman, A. (1995). Volume Sculpting. ACM Symposium on Interactive 3D Graphics, p. 151--156.]]
[42]
Yagou, H., Ohtake, Y., & Belyaev, A. (2002). Mesh smoothing via mean and median filtering applied to face normals. IEEE Geometric Modeling and Processing Theory and Applications Conference, p. 124--131.]]
[43]
Zelezink, R. C., Herndon, K., & Hughes, J. (1996). SKETCH: An interface for sketching 3D scenes. SIGGRAPH. p. 163--170.]]

Cited By

View all
  • (2021)Altering Perceived Softness of Real Rigid Objects by Restricting Fingerpad DeformationThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474800(985-996)Online publication date: 10-Oct-2021
  • (2021)Exploring a Feedback-Oriented Design Process Through Curved FoldingProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445639(1-8)Online publication date: 6-May-2021
  • (2021)A Motion‐guided Interface for Modeling 3D Multi‐functional FurnitureComputer Graphics Forum10.1111/cgf.1441640:7(229-240)Online publication date: 27-Nov-2021
  • Show More Cited By

Index Terms

  1. An interface for virtual 3D sculpting via physical proxy

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    GRAPHITE '06: Proceedings of the 4th international conference on Computer graphics and interactive techniques in Australasia and Southeast Asia
    November 2006
    489 pages
    ISBN:1595935649
    DOI:10.1145/1174429
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 29 November 2006

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. clay modeling
    2. conceptual 3D modeling
    3. direct finger input
    4. gestural interaction
    5. high degree-of-freedom input

    Qualifiers

    • Article

    Conference

    GRAPHITE06
    Sponsor:

    Acceptance Rates

    GRAPHITE '06 Paper Acceptance Rate 47 of 83 submissions, 57%;
    Overall Acceptance Rate 124 of 241 submissions, 51%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 09 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2021)Altering Perceived Softness of Real Rigid Objects by Restricting Fingerpad DeformationThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474800(985-996)Online publication date: 10-Oct-2021
    • (2021)Exploring a Feedback-Oriented Design Process Through Curved FoldingProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445639(1-8)Online publication date: 6-May-2021
    • (2021)A Motion‐guided Interface for Modeling 3D Multi‐functional FurnitureComputer Graphics Forum10.1111/cgf.1441640:7(229-240)Online publication date: 27-Nov-2021
    • (2021)Augmenting Perceived Softness of Haptic Proxy Objects Through Transient Vibration and Visuo-Haptic Illusion in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.300224527:12(4387-4400)Online publication date: 1-Dec-2021
    • (2021)Visual Pseudo Haptics for a Dynamic Squeeze / Grab Gesture in Immersive Virtual Reality2021 IEEE 2nd International Conference on Human-Machine Systems (ICHMS)10.1109/ICHMS53169.2021.9582654(1-4)Online publication date: 8-Sep-2021
    • (2021)Lego®-like Bricks to Go from the Real to the Virtual WorldHCI International 2021 - Late Breaking Posters10.1007/978-3-030-90176-9_13(91-98)Online publication date: 6-Nov-2021
    • (2021)Understanding the Role of Physical and Digital Techniques in the Initial Design Processes of ArchitectureHuman-Computer Interaction – INTERACT 202110.1007/978-3-030-85616-8_19(312-329)Online publication date: 26-Aug-2021
    • (2020)Tangi: Tangible Proxies For Embodied Object Exploration And Manipulation In Virtual Reality2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR50242.2020.00042(195-206)Online publication date: Nov-2020
    • (2019)Signifier-Based Immersive and Interactive 3D ModelingProceedings of the 25th ACM Symposium on Virtual Reality Software and Technology10.1145/3359996.3364257(1-5)Online publication date: 12-Nov-2019
    • (2019)MagicalHandsProceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology10.1145/3332165.3347942(463-477)Online publication date: 17-Oct-2019
    • Show More Cited By

    View Options

    View options

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media