skip to main content
10.1145/1027933.1027983acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
Article

GroupMedia: distributed multi-modal interfaces

Published: 13 October 2004 Publication History

Abstract

In this paper, we describe the GroupMedia system, which uses wireless wearable computers to measure audio features, head-movement, and galvanic skin response (GSR) for dyads and groups of interacting people. These group sensor measurements are then used to build a real-time <i>group interest index</i>. The group interest index can be used to control group displays, annotate the group discussion for later retrieval, and even to modulate and guide the group discussion itself. We explore three different situations where this system has been introduced, and report experimental results.

References

[1]
Bales, R. F. Social interaction systems: Theory and measurement. New Brunswick, NJ:Transaction Publishers, 1999.
[2]
Basu, S, "Conversation Scene Analysis", in Dept. of Electrical Engineering and Computer science. Doctoral, MIT, 2002.
[3]
Brand, M., Oliver, N., and Pentland, S., "Coupled hidden Markov models for complex action," IEEE Conference on Computer Vision and Pattern Recognition (CVPR97), 1996.
[4]
Briñol, P. and Petty, R.E., "Overt head movements and persuasion: A Self-validation analysis." Journal of Personality and Social Psychology, 84, 1123-1139, 2003.
[5]
Chartrand, T.L., and Bargh, J.A., "The chameleon effect: The preception-behavior link and social interaction." Journal of Personality and Social Psychology, 76, 893-910, 1999.
[6]
Choudhury, T., "Sensing and Modeling Human Networks." PhD thesis, Dept of MAS, MIT, 2003.
[7]
Contexual Computing Group, Georgia Tech, GA Bluetooth accelerometer design (http://www.cc.gatech.edu/ccg/resources/btacc/index.html)
[8]
DeVaul, R. W. and Pentland, S., "The MIThril Real-Time Context Engine and Activity Classification", Technical Report, MIT Media Lab, 2003
[9]
DeVaul, R.W., Sung, M., Gips, J., Pentland, S., "MIThril 2003: Applications and Architecture", Proc. ISWC '03, White Plains, N.Y., October 2003, pp 4- 11.
[10]
Eagle, N. and Pentland, A., "Social Network Computing", Ubicomp 2003: Ubiquitous Computing, Springer-Verlag Lecture Notes in Computer Science 2864, pp. 289-296, 2003.
[11]
Fuller, G. D., "GSR History, & Physiology" taken from Biofeedbacks Methods and Procedures in clinical practice, 1977.
[12]
Gerasimov, V., Hoarder Data Acquisition System, (http://vadim.www.media.mit.edu/Hoarder/Hoarder.htm)
[13]
Healey, J. and Picard, R. W.,"StartleCam: A Cybernetic Wearable Camera", In Proc. ICWC '98, 1998
[14]
Kapoor, A. and Picard, R. W., "A real-time head and nod shake detector". In IEEE PUI, Orlando, FL, 2001.
[15]
Keyes, E., Enchantment White paper, MIT Media Laboratory
[16]
Marci, C., "Psychotherapy Correlates of Empathy, An investigation of the patient-clinical dyad", 2002
[17]
Morris DiMicco, J., "Designing Interfaces that Influence Group Processes". Doctoral Consortium Proceedings of the Conference on Human Factors in Computer Systems (CHI 2004), Vienna, Austria, April 2004.
[18]
Miller, J.G., Living System, McGraw-Hill, New York.
[19]
Pentland A, Curhan J, Eagle N, Martin M., "Money and Influence", Media Lab Technical Note 577, May 2004
[20]
Pentland A, "Social Dynamics: The Voice of Power and Influence", Media Lab Technical Note 579, May 2004
[21]
Picard, R.W., "Affective Computing", MIT Press, Cambridge
[22]
Reynolds C. Strauss M., Picard R.W. MIT Media Laboratory, Bluetooth GSR sensor design (http://arsenal.media.mit.edu/notebook/archives/cat_projects.html)
[23]
Terry, M., Mynatt, E. D., Ryall, K., and Leigh, D. "Social Net: Using Patterns of Physical Proximity Over Time to Infer Shared Interests", CHI 2002 Extended
[24]
Toney, A. and Dunne, L., "A Shoulder pad insert for Vibrotactile Display", Proc ISWC '03, White Plains, N.Y., October 2003

Cited By

View all
  • (2020)Classification and prediction of social attributes By K-Nearest Neighbor Algorithm with Socially-aware wireless networking-A studyIOP Conference Series: Materials Science and Engineering10.1088/1757-899X/937/1/012051937(012051)Online publication date: 2-Oct-2020
  • (2019)Blink as you syncProceedings of the 2019 ACM International Symposium on Wearable Computers10.1145/3341163.3347736(66-71)Online publication date: 9-Sep-2019
  • (2019)Human dynamicsPattern Recognition Letters10.1016/j.patrec.2004.08.01226:4(503-511)Online publication date: 6-Jan-2019
  • Show More Cited By

Index Terms

  1. GroupMedia: distributed multi-modal interfaces

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      ICMI '04: Proceedings of the 6th international conference on Multimodal interfaces
      October 2004
      368 pages
      ISBN:1581139950
      DOI:10.1145/1027933
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 13 October 2004

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. galvanic skin response
      2. head nodding
      3. human behavior
      4. influence model
      5. interest
      6. prosody
      7. speech features

      Qualifiers

      • Article

      Conference

      ICMI04
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 453 of 1,080 submissions, 42%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)4
      • Downloads (Last 6 weeks)1
      Reflects downloads up to 16 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2020)Classification and prediction of social attributes By K-Nearest Neighbor Algorithm with Socially-aware wireless networking-A studyIOP Conference Series: Materials Science and Engineering10.1088/1757-899X/937/1/012051937(012051)Online publication date: 2-Oct-2020
      • (2019)Blink as you syncProceedings of the 2019 ACM International Symposium on Wearable Computers10.1145/3341163.3347736(66-71)Online publication date: 9-Sep-2019
      • (2019)Human dynamicsPattern Recognition Letters10.1016/j.patrec.2004.08.01226:4(503-511)Online publication date: 6-Jan-2019
      • (2018)Smart classroom system for detecting level of interest a lecture creates in a classroomJournal of Ambient Intelligence and Smart Environments10.5555/2756713.27567247:2(271-284)Online publication date: 15-Dec-2018
      • (2018)System for recognizing lecture quality based on analysis of physical parametersTelematics and Informatics10.1016/j.tele.2017.06.01435:3(579-594)Online publication date: Jun-2018
      • (2018)Multimodal Analytics for Real-Time Feedback in Co-located CollaborationLifelong Technology-Enhanced Learning10.1007/978-3-319-98572-5_15(187-201)Online publication date: 14-Aug-2018
      • (2017)How may I help you? behavior and impressions in hospitality service encountersProceedings of the 19th ACM International Conference on Multimodal Interaction10.1145/3136755.3136771(312-320)Online publication date: 3-Nov-2017
      • (2017)eTheatreProceedings of the Fifth International Symposium of Chinese CHI10.1145/3080631.3080633(1-10)Online publication date: 8-Jun-2017
      • (2015)Towards effective group work assessment: even what you don’t see can bias youInternational Journal of Technology and Design Education10.1007/s10798-015-9332-127:1(165-180)Online publication date: 23-Sep-2015
      • (2014)Do we react in the same manner?Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational10.1145/2639189.2639201(501-510)Online publication date: 26-Oct-2014
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media