Multimodal mobile-ambient transmedial twirling with environmental lighting to complement fluid perspective with phase-perturbed affordance projection

ABSTRACT

To illuminate the alignment between mixed reality juggling toys and ambidextrous vactors twirling a projection of those toys, roomware lighting control is deployed to show the modeled position of a virtual camera spinning around each player, even while the affordances are whirled. "Tworlds" is a mixed reality multimodal toy using twirled juggling-style affordances built using mobile devices--- smartphones, phablets, & tablets--- to modulate various displays, including 3D models and, now, environmental lighting. A unique feature of the projection is the preservation of logical alignment even when the virtual camera moves continuously around an avatar between frontal and dorsal views in an "inspection gesture," phase-locked rotation and revolution (like the face of the moon pointing at the Earth). For example, a right-handed user would prefer to see their self-identified puppet holding an affordance in the right hand for dorsal (tethered) views, but would rather see the puppet switch hands for a frontal (mirrored) perspective. Because the projected phase of the toy must be modulated in order to preserve such visual correspondence, even while the prop is being whirled, and to elucidate the inspection gesture, we use networked lighting (Philips Hue Wi-Fi networked bulbs) to indicate the position of the virtual camera. Even though a toy might be twirled too fast for such lights to track in the real world, so that only computer graphic "eye candy" effects are practical, the speed of the orbiting of the virtual camera can be adjusted to accommodate even sluggish lighting switching.

References

1. Cohen, M., Ranaweera, R., Nishimura, K., Sasamoto, Y., Endo, S., Oyama, T., Ohashi, T., Nishikawa, Y., Kanno, R., Nakada, A., Villegas, J., Chen, Y. P., Holesch, S., Yamadera, J., Ito, H., Saito, Y., and Sasaki, A. 2013. "Twirled Affordances, Self-Conscious Avatars, & Inspection Gestures. In SIGGRAPH Asia Symp. on Mobile Graphics and Interactive Applications. Poster Demonstration. http://dl.acm.org/citation.cfm?id=2543691.
2. Cohen, M., Ranaweera, R., Nishimura, K., Sasamoto, Y., Endo, S., Oyama, T., Ohashi, T., Nishikawa, Y., Kanno, R., Nakada, A., Villegas, J., Chen, Y. P., Holesch, S., Yamadera, J., Ito, H., Saito, Y., and Sasaki, A. 2013. "Tworlds": Twirled Worlds for Multimodal 'Padiddle' Spinning & Tethered 'Poi' Whirling. In SIGGRAPH. Poster. http://dl.acm.org/citation. cfm?doid=2503385.2503459, ISBN 978-1-4503-2342-0, http://www.youtube.com/watch?v=sKruOxXJBNU.
3. Olsen, V. S. 2011. Alice 3 Cookbook. Packt Publishing Ltd., Birmingham, UK. ISBN-10 1-849514-92-5, ISBN-13 978-1-849514-92-7.

Index Terms

• Applied computing

  • Arts and humanities

    • Sound and music computing

• Computing methodologies

  • Computer graphics

    • Graphics systems and interfaces

      • Virtual reality

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction devices

      • Graphics input devices

    • Interaction paradigms

      • Mixed / augmented reality

      • Virtual reality