ABSTRACT
GroupTogether is a system that explores cross-device interaction using two sociological constructs. First, F-formations concern the distance and relative body orientation among multiple users, which indicate when and how people position themselves as a group. Second, micro-mobility describes how people orient and tilt devices towards one another to promote fine-grained sharing during co-present collaboration. We sense these constructs using: (a) a pair of overhead Kinect depth cameras to sense small groups of people, (b) low-power 8GHz band radio modules to establish the identity, presence, and coarse-grained relative locations of devices, and (c) accelerometers to detect tilting of slate devices. The resulting system supports fluid, minimally disruptive techniques for co-located collaboration by leveraging the proxemics of people as well as the proxemics of devices.
Supplemental Material
- Ballendat, T., et al., Proxemic Interaction: Designing for a Proximity and Orientation-Aware Environment. ITS '10. Google ScholarDigital Library
- Biehl, J. T., Bailey, B. P. ARIS: An Interface for Application Relocation in an Interactive Space. Proc. Graphics Interface (GI '04). Google ScholarDigital Library
- Bragdon, A., et al., Code Space: Combining Touch, Devices, and Skeletal Tracking to Support Developer Meetings. ITS '11.Google Scholar
- Buxton, W., Living in augmented reality: Ubiquitous Media and Reactive Environments, in Video Mediated Communication, ed. by K. Finn, Sellen, A., & Wilber, S. 1997, Erlbaum. p. 363--384.Google Scholar
- Ciolek, T. M., Kendon, A., Environment and the Spatial Arrangement of Conversational Encounters. Sociological Inquiry 1980. 50(3--4): p. 237--271.Google Scholar
- Dearman, D., Guy, R., Truong, K. Determining the Orientation of Proximate Mobile Devices using their Back Facing Camera. CHI'12. Google ScholarDigital Library
- Dunbar, R., Duncan, N., Nettle, D., Size and Structure of Freely Forming Conversational Groups. Human Nature, 1995. 6(1): p. 67--78.Google Scholar
- Everitt, K., Shen, C., Ryall, K., Forlines, C. MultiSpace: Enabling Electronic Document Micro-mobility in Table-Centric, Multi-Device Environments. Proc. IEEE TABLETOP '06. Google ScholarDigital Library
- Greenberg, S., et al., Proxemic Interactions: The New Ubicomp? Interactions, 2011. 18(1): p. 42--50. Google ScholarDigital Library
- Hall, E. T., The Hidden Dimension. 1966, New York: Doubleday.Google Scholar
- Hassan, N., Rahman, M., Irani, P., Graham, P. Chucking: A One-Handed Document Sharing Technique. INTERACT'09. Google ScholarDigital Library
- Hinckley, K. Synchronous Gestures for Multiple Users and Computers. UIST'03. Google ScholarDigital Library
- Hinckley, K., Dixon, M., Sarin, R., Guimbretiere, F., Balakrishnan, R. Codex: A Dual-Screen Tablet Computer. CHI'09. Google ScholarDigital Library
- Hung, H., Kröse, B. J. A. Detecting F-formations as dominant sets. Proc ICMI '11 Conf. on Multimodal Interfaces. Google ScholarDigital Library
- Johanson, B., et al., PointRight: experience with flexible input redirection in interactive workspaces. UIST'02. Google ScholarDigital Library
- Ju, W., Lee, B. A., Klemmer, S. R. Range: Exploring Implicit Interaction through Electronic Whiteboard Design. CSCW '08. Google ScholarDigital Library
- Kendon, A., Spacing and orientation in co-present interaction, in COST'09 Proceedings 2nd Int'l Conf on Development of Multimodal Interfaces: Active Listening and Synchrony, Springer-Verlag Berlin: Heidelberg. p. 1--15. Google ScholarDigital Library
- Kindberg, T., Fox, A., System Software for Ubiquitous Computing. IEEE Pervasive Computing, 2002. 1(1): p. 70--81. Google ScholarDigital Library
- Kruger, R., Carpendale, M., Scott, S. D., Greenberg, S. How People Use Orientation on Tables: Comprehension, Coordination and Communication. Proc. ACM Group 2003 Conference. Google ScholarDigital Library
- Luff, P., Heath, C. Mobility in collaboration. CSCW '98. Google ScholarDigital Library
- Marquardt, N., Diaz-Marino, R., Boring, S., Greenberg, S. The Proximity Toolkit: Prototyping Proxemic Interactions in Ubiquitous Computing Ecologies. UIST '11. Google ScholarDigital Library
- Marshall, P., Rogers, Y., Pantidi, N. Using F-formations to analyse spatial patterns of interaction in physical environments. CSCW '11. Google ScholarDigital Library
- Ramos, G., et al., Synchronous Gestures in Multi-Display Environments. Human-Comp. Interaction, 2009. 24 (1-2): p. 117--169.Google Scholar
- Rodden, T. Populating the application: a model of awareness for cooperative applications. CSCW '96. Google ScholarDigital Library
- Schilit, B., Adams, N., Want, R. Context-Aware Computing Applications. Proc. IEEE Workshop on Mobile Computing Systems and Applications. 1994. Google ScholarDigital Library
- Sommer, R., Personal space. 1969: Prentice-Hall.Google Scholar
- Tashman, C., Edwards, W. K. LiquidText: A Flexible, Multitouch Environment to Support Active Reading. CHI'11. Google ScholarDigital Library
- Vogel, D., Balakrishnan, R. Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users. UIST'04. Google ScholarDigital Library
- Wang, M., Boring, S., Greenberg, S., Proxemic Peddler: A Public Advertising Display that Captures and Preserves the Attention of a Passerby. ACM 2012 Int'l Symp. on Pervasive Displays. Google ScholarDigital Library
- Want, R., et al, The active bage location system. ACM Trans. Information Systems, 1992. 10(1): p. 91--102. Google ScholarDigital Library
- Wilson, A. D., Benko, H. Combining multiple depth cameras and projectors for interactions on, above and between surfaces. UIST'10. Google ScholarDigital Library
Index Terms
Cross-device interaction via micro-mobility and f-formations
Recommendations
AirConstellations: In-Air Device Formations for Cross-Device Interaction via Multiple Spatially-Aware Armatures
UIST '21: The 34th Annual ACM Symposium on User Interface Software and TechnologyAirConstellations supports a unique semi-fixed style of cross-device interactions via multiple self-spatially-aware armatures to which users can easily attach (or detach) tablets and other devices. In particular, AirConstellations affords highly flexible ...
Proxemic interaction: designing for a proximity and orientation-aware environment
ITS '10: ACM International Conference on Interactive Tabletops and SurfacesIn the everyday world, much of what we do is dictated by how we interpret spatial relationships, or proxemics. What is surprising is how little proxemics are used to mediate people's interactions with surrounding digital devices. We imagine proxemic ...
Sensing Tablet Grasp + Micro-mobility for Active Reading
UIST '15: Proceedings of the 28th Annual ACM Symposium on User Interface Software & TechnologyThe orientation and repositioning of physical artefacts (such as paper documents) to afford shared viewing of content, or to steer the attention of others to specific details, is known as micro-mobility. But the role of grasp in micro-mobility has ...
Comments