tutorial

Mobile social signal processing: vision and research issues

Authors:

Alessandro Vinciarelli,

Roderick Murray-Smith,

Hervé BourlardAuthors Info & Claims

MobileHCI '10: Proceedings of the 12th international conference on Human computer interaction with mobile devices and services

Pages 513 - 516

https://doi.org/10.1145/1851600.1851731

Published: 07 September 2010 Publication History

Abstract

This paper introduces the First International Workshop on Mobile Social Signal Processing (SSP). The Workshop aims at bringing together the Mobile HCI and Social Signal Processing research communities. The former investigates approaches for effective interaction with mobile and wearable devices, while the latter focuses on modeling, analysis and synthesis of nonverbal behavior in human{human and human-machine interactions. While dealing with similar problems, the two domains have different goals and methodologies. However, mutual exchange of expertise is likely to raise new research questions as well as to improve approaches in both domains. After providing a brief survey of Mobile HCI and SSP, the paper introduces general aspects of the workshop (including topics, keynote speakers and dissemination means).

References

[1]

N. Ambady, F. Bernieri, and J. Richeson. Towards a histology of social behavior: judgmental accuracy from thin slices of behavior. In M. Zanna, editor, Advances in Experimental Social Psychology, pages 201--272. 2000.

[2]

N. Ambady and R. Rosenthal. Thin slices of expressive behavior as predictors of interpersonal consequences: a meta-analysis. Psychological Bulletin, 111(2):256--274, 1992.

[3]

I. Arminen and A. Weilenmann. Mobile presence and intimacy-Reshaping social actions in mobile contextual configuration. Journal of Pragmatics, 41(10):1905--1923, 2009.

[4]

V. Bellotti, M. Back, W. K. Edwards, R. E. Grinter, A. Henderson, and C. Lopes. Making sense of sensing systems: five questions for designers and researchers. In Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, CHI '02, pages 415--422, New York, NY, USA, 2002. ACM.

Digital Library

[5]

S. Benford, H. Schnadelbach, B. K., R. Anastasi, C. Greenhalgh, T. Rodden, J. Green, A. Ghali, T. Pridmore, B. Gaver, A. Boucher, B. Walker, S. Pennington, A. Schmidt, H. Gellersen, and A. Steed. Expected, sensed, and desired: A framework for designing sensing-based interaction. ACM Trans. Comput.-Hum. Interact., 12:3--30, March 2005.

Digital Library

[6]

C. Bishop et al. Pattern recognition and machine learning. Springer, 2006.

Digital Library

[7]

J. Carletta, S. Ashby, S. Bourban, M. Flynn, M. Guillemot, T. Hain, J. Kadlec, V. Karaiskos, W. Kraaij, M. Kronenthal, et al. The AMI meeting corpus: A pre-announcement. In Lecture notes in computer science, volume 3869, pages 28--39, 2005.

Digital Library

[8]

J. Cassell, T. Bickmore, M. Billinghurst, L. Campbell, K. Chang, H. Vilhjalmsson, and H. Yan. Embodiment in conversational interfaces: Rea. In Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, page 527. ACM, 1999.

Digital Library

[9]

A. Crossan, R. Murray-Smith, S. Brewster, and B. Musizza. Instrumented Usability Analysis for Mobile Devices. Handbook of Research on User Interface Design and Evaluation for Mobile Technology, 2007.

[10]

M. Knapp and J. Hall. Nonverbal Communication in Human Interaction. Harcourt Brace College Publishers, 1972.

[11]

D. Koller and N. Friedman. Probabilistic Graphical Models: Principles and Techniques. The MIT Press, 2009.

Digital Library

[12]

C. Licoppe. Recognizing mutual "proximity" at a distance: Weaving together mobility, sociality and technology. Journal of Pragmatics, 41(10):1924--1937, 2009.

[13]

J. Lumsden. Handbook of Research on User Interface Design and Evaluation for Mobile Technology. IGI Global, 2008.

[14]

S. Mitra and T. Acharya. Gesture recognition: A survey. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews, 37(3):311--324, 2007.

Digital Library

[15]

A. Morrison, M. Bell, and M. Chalmers. Visualisation of spectator activity at stadium events. In Information Visualisation, 2009 13th International Conference, pages 219--226, 2009.

Digital Library

[16]

R. Murray-Smith, A. Ramsay, S. Garrod, M. Jackson, and B. Musizza. Gait alignment in mobile phone conversations. In Proc. of Mobile HCI 07, pages 214--221, 2007.

Digital Library

[17]

C. Nass and S. Brave. Wired for speech: How voice activates and advances the Human-Computer relationship. The MIT Press, 2005.

Digital Library

[18]

A. Oulasvirta, S. Tamminen, V. Roto, and J. Kuorelahti. Interaction in 4-second bursts: the fragmented nature of attentional resources in mobile hci. In Proceedings of the SIGCHI conference on Human factors in computing systems, CHI '05, pages 919--928, New York, NY, USA, 2005. ACM.

Digital Library

[19]

I. Poggi. Mind, Hands, Face and Body: A Goal and Belief View of Multimodal Communication. Weidler Buchverlag Berlin, 2007.

[20]

M. Raento, A. Oulasvirta, and N. Eagle. Smartphones: an emerging tool for social scientists. Sociological Methods & Research, 37(3):426, 2009.

[21]

B. Reeves and C. Nass. The media equation: How people treat computers, television, and new media like real people and places. Cambridge University Press New York, NY, USA, New York (USA), 1996.

Digital Library

[22]

V. Richmond and J. McCroskey. Nonverbal Behaviors in interpersonal relations. Allyn and Bacon, 1995.

[23]

V. Roto, A. Oulasvirta, T. Haikarainen, J. Kuorelahti, H. Lehmuskallio, and T. Nyyssonen. Examining mobile phone use in the wild with quasi-experimentation. Helsinki Institute for Information Technology (HIIT), Technical Report, 1, 2004.

[24]

E. Schegloff. Analyzing single episodes of interaction: An exercise in conversation analysis. Social Psychology Quarterly, 50(2):101--114, 1987.

[25]

M. Schroder. Expressive speech synthesis: Past, present, and possible futures. In A ective Information Processing, pages 111--126. Springer, 2008.

[26]

S. Tranter and D. Reynolds. An overview of automatic speaker diarization systems. IEEE Transactions on Audio, Speech, and Language Processing, 14(5):1557--1565, 2006.

Digital Library

[27]

A. Vinciarelli. Capturing order in social interactions. IEEE Signal Processing Magazine, 26(5):133--137, 2009.

[28]

A. Vinciarelli, M. Pantic, and H. Bourlard. Social Signal Processing: Survey of an emerging domain. Image and Vision Computing Journal, 27(12):1743--1759, 2009.

Digital Library

[29]

A. Vinciarelli, M. Pantic, H. Bourlard, and A. Pentland. Social Signal Processing: State-of-the-art and future perspectives of an emerging domain. In Proceedings of the ACM International Conference on Multimedia, pages 1061--1070, 2008.

Digital Library

[30]

M. Yang, D. Kriegman, and N. Ahuja. Detecting faces in images: a survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(1):34--58, 2002.

Digital Library

[31]

Z. Zeng, M. Pantic, G. Roisman, and T. Huang. A survey of affect recognition methods: audio, visual and spontaneous expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(1):39--58, 2009.

Digital Library

Cited By

Vasconcellos e Souza IPereira WLima J(2018)An Approach for Detecting Social Interactions on Mobile DevicesMobile Applications and Solutions for Social Inclusion10.4018/978-1-5225-5270-3.ch001(1-27)Online publication date: 2018
https://doi.org/10.4018/978-1-5225-5270-3.ch001
Flutura SWagner JLingenfelser FSeiderer AAndré ENakano YAndré ENishida TMorency LBusso CPelachaud C(2016)MobileSSI: asynchronous fusion for social signal interpretation in the wildProceedings of the 18th ACM International Conference on Multimodal Interaction10.1145/2993148.2993164(266-273)Online publication date: 31-Oct-2016
https://dl.acm.org/doi/10.1145/2993148.2993164
Palaghias NHoseinitabatabaei SNati MGluhak AMoessner K(2016)A Survey on Mobile Social Signal ProcessingACM Computing Surveys10.1145/289348748:4(1-52)Online publication date: 18-Mar-2016
https://doi.org/10.1145/2893487
Show More Cited By

Index Terms

Mobile social signal processing: vision and research issues
1. Applied computing
  1. Law, social and behavioral sciences
    1. Psychology
    2. Sociology

Recommendations

A Survey on Mobile Social Signal Processing

Understanding human behavior in an automatic but nonintrusive manner is an important area for various applications. This requires the collaboration of information technology with human sciences to transfer existing knowledge of human behavior into self-...
ASSP4MI2016: 2nd international workshop on advancements in social signal processing for multimodal interaction (workshop summary)
ICMI '16: Proceedings of the 18th ACM International Conference on Multimodal Interaction

This paper gives a summary of the 2nd International Workshop on Advancements in Social Signal Processing for Multimodal Interaction (ASSP4MI). Following our successful 1st International Workshop on Advancements in Social Signal Processing for ...
SSPW '10: Proceedings of the 2nd international workshop on Social signal processing

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

MobileHCI '10: Proceedings of the 12th international conference on Human computer interaction with mobile devices and services

September 2010

552 pages

ISBN:9781605588353

DOI:10.1145/1851600

General Chairs:
Marco de Sá
LaSIGE & University of Lisboa, Portugal
,
Luís Carriço
LaSIGE & University of Lisboa, Portugal
,
Program Chair:
Nuno Correia
CITI & New University of Lisboa, Portugal

Copyright © 2010 Copyright is held by the author/owner(s).

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 September 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Tutorial

Conference

MobileHCI '10

MobileHCI '10: 12th International Conference on Human Computer Interaction with Mobile Devices and Services

September 7 - 10, 2010

Lisbon, Portugal

Acceptance Rates

MobileHCI '10 Paper Acceptance Rate 46 of 225 submissions, 20%;

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
317
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Vasconcellos e Souza IPereira WLima J(2018)An Approach for Detecting Social Interactions on Mobile DevicesMobile Applications and Solutions for Social Inclusion10.4018/978-1-5225-5270-3.ch001(1-27)Online publication date: 2018
https://doi.org/10.4018/978-1-5225-5270-3.ch001
Flutura SWagner JLingenfelser FSeiderer AAndré ENakano YAndré ENishida TMorency LBusso CPelachaud C(2016)MobileSSI: asynchronous fusion for social signal interpretation in the wildProceedings of the 18th ACM International Conference on Multimodal Interaction10.1145/2993148.2993164(266-273)Online publication date: 31-Oct-2016
https://dl.acm.org/doi/10.1145/2993148.2993164
Palaghias NHoseinitabatabaei SNati MGluhak AMoessner K(2016)A Survey on Mobile Social Signal ProcessingACM Computing Surveys10.1145/289348748:4(1-52)Online publication date: 18-Mar-2016
https://doi.org/10.1145/2893487
Flutura SWagner JLingenfelser FSeiderer AAndre E(2016)MobileSSI - A Multi-modal Framework for Social Signal Interpretation on Mobile Devices2016 12th International Conference on Intelligent Environments (IE)10.1109/IE.2016.47(210-213)Online publication date: Sep-2016
https://doi.org/10.1109/IE.2016.47
Vinciarelli AEsposito AAndré EBonin FChetouani MCohn JCristani MFuhrmann FGilmartin EHammal ZHeylen DKaiser RKoutsombogera MPotamianos ARenals SRiccardi GSalah A(2015)Open Challenges in Modelling, Analysis and Synthesis of Human Behaviour in Human–Human and Human–Machine InteractionsCognitive Computation10.1007/s12559-015-9326-z7:4(397-413)Online publication date: 12-Apr-2015
https://doi.org/10.1007/s12559-015-9326-z
André EHeylen DVinciarelli A(2014)Challenges for Social EmbodimentProceedings of the 2014 Workshop on Roadmapping the Future of Multimodal Interaction Research including Business Opportunities and Challenges10.1145/2666253.2666265(35-37)Online publication date: 16-Nov-2014
https://dl.acm.org/doi/10.1145/2666253.2666265

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten