skip to main content
10.1145/1180639.1180829acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
Article

Human-centered computing: a multimedia perspective

Published: 23 October 2006 Publication History

Abstract

Human-Centered Computing (HCC) is a set of methodologies that apply to any field that uses computers, in any form, in applications in which humans directly interact with devices or systems that use computer technologies. In this paper, we give an overview of HCC from a Multimedia perspective. We describe what we consider to be the three main areas of Human-Centered Multimedia (HCM): media production, analysis, and interaction. In addition, we identify the core characteristics of HCM, describe example applications, and propose a research agenda for HCM.

References

[1]
R. Hoffman, P. Feltovich, K. Ford, D. Woods, G. Klein, A. Feltovich, "A Rose by Any Other Name - Would Probably Be Given an Acronym," IEEE Intelligent Systems, 17(4):72--80, 2002.
[2]
J. Flanagan, T. Huang, P. Jones, S. Kasif (eds.), "Human-centered Systems: Information, Interactivity, and Intelligence," Report, NSF, 1997.
[3]
W. Clancey, Situated Cognition: On Human Knowledge and Computer Representations, Cambridge University Press, 1997.
[4]
R. Hoffman, "Human-centered Computing Principles for Advanced Decision Architectures," Report, Army Research Laboratory, 2004.
[5]
J. Canny, "Human-center Computing," Report of the UC Berkeley HCC Retreat, 2001.
[6]
J. Foley, et al., HCC Educational Digital Library, http://hcc.cc.gatech.edu
[7]
http://www.cs.berkeley.edu/~jfc/hcc/
[8]
http://www-static.cc.gatech.edu/academics/grad/hcc-overview.shtml
[9]
http://www.ihmc.us
[10]
ACM Workshop on Capture, Archival, and Retrieval of Personal Experiences (CARPE), 2005.
[11]
http://www.nsf.gov/cise/iis/about.jsp
[12]
http://www-nlpir.nist.gov/projects/trecvid
[13]
M. Dertouzos, The Unfinished Revolution: Human-centered Computers and What They Can Do for Us, HarperCollins, 2001.
[14]
M. Weiser, "Some computer science issues in ubiquitous computing," Comm. of the ACM, 36(7):74--83, 1993.
[15]
V.I. Pavlovic, R. Sharma and T.S. Huang, "Visual interpretation of hand gestures for human-computer interaction: A review", IEEE Trans. on PAMI, 19(7):677--695, 1997.
[16]
G. Potamianos, C. Neti, J. Luettin, and I. Matthews, "Audio-visual automatic speech recognition: An overview," Issues in Visual and Audio-Visual Speech Processing, MIT Press, 2004.
[17]
M. Benali-Khoudja, M. Hafez, J.-M. Alexandre, and A. Kheddar, "Tactile interfaces: A state-of-the-art survey," Int. Symposium on Robotics, 2004.
[18]
K. Grauman, M. Betke, J. Lombardi, J. Gips, and G. Bradski, "Communication via eye blinks and eyebrow raises: Videobased human-computer interfaces," Universal Access in Inf. Society, 2(4):359--373, 2003.
[19]
C. Borst and R. Volz, "Evaluation of a haptic mixed reality system for interactions with a virtual control panel," Presence: Teleoperators and Virtual Environments, 14(6), 2005.
[20]
G. Fitzmaurice, H. Ishii, and W.Buxton, "Bricks: Laying the foundations for graspable user interfaces," ACM CHI, 1(442--449), 1995.
[21]
R. Jacob, "The use of eye movements in human-computer interactions techniques: What you look at is what you get," ACM Trans. Information Systems, 9(3):152--169, 1991.
[22]
S.L. Oviatt, "Mutual disambiguation of recognition errors in a multimodal architecture," ACM CHI, 1999.
[23]
S.L. Oviatt, "Ten myths of multimodal interaction," Comm. of the ACM, 42(11):74--81, 1999.
[24]
E. Arts, "Ambient Intelligence: A Multimedia Perspective," IEEE Multimedia, 11(1):12--19, 2004.
[25]
E. Brewer et al., "The Case For Technology For Developing Regions," Computer, 38(6):25--38, 2005.
[26]
R. Jain, "Folk Computing," Comm. ACM, 46(4):27--29, 2003.
[27]
A. Jaimes, "Human-Centered Multimedia: Culture, Deployment, and Access", IEEE Multimedia Magazine, 13(1):12--19, 2006.
[28]
A. Jaimes and S.-F. Chang, "A Conceptual Framework for Indexing Visual Information at Multiple Levels", SPIE Internet Imaging, Vol. 3964, pp. 2--15, 2000.
[29]
N. Dimitrova, "Context and Memory in Multimedia Content Analysis," IEEE Multimedia, 11(3):7--11, 2004.
[30]
A. Pentland, "Socially Aware Computation and Communication," Computer, 38(3):33--40, 2005.
[31]
T.S. Andersen, K. Tiippana, and M. Sams, "Factors Influencing Audiovisual Fission and Fusion Illusions," Cognitive Brain Research 21, 2004, pp. 301--308.
[32]
S. Deneve and A. Pouget, "Bayesian Multisensory Integration and Cross-Modal Spatial Links," J. Physiology Paris, 98 (1-3), 2004, pp. 249--258.
[33]
C.E. Schroeder and J. Foxe, "Multisensory Contributions to Low-level, 'Unisensory' Processing," Current Opinion in Neurobiology, vol. 15, 2005, pp. 454--458.
[34]
S. Boll, "Image and Video Retrieval from a User-Centered Mobile Multimedia Perspective," Proc. Int'l Conf. Image and Video Retrieval, Springer LNCS vol. 3568, 2005.
[35]
M. Davis and R. Sarvas, "Mobile Media Metadata for Mobile Imaging," Proc. IEEE Int'l Conf. Multimedia and Expo, 2004, pp. 936--937.
[36]
A. Jaimes and N. Sebe, "Multimodal HCI: A Survey," Proc. IEEE Int'l Workshop on Human-Computer Interaction in conj. with IEEE ICCV 2005, Oct., 2005.
[37]
J. Bohn et al., "Social, Economic, and Ethical Implications of Ambient Intelligence and Ubiquitous Computing," Ambient Intelligence, Springer, 2005, pp. 5--29.
[38]
L. Rowe and R. Jain, "ACM SIGMM Retreat Report," ACM Trans. Multimedia Computing, Communications, and Applications, 1(1):3--13, 2005.
[39]
M. Gladwell, Blink, Little Brown and Co., New York, 2005.
[40]
D. Zhang, D. Gatica-Perez, S. Bengio, and D. Roy, "Learning Influence among Interacting Markov Chains," NIPS, 2005.
[41]
J. Karat and C.M. Karat "The Evolution of User-Centered Focus in the Human-Computer Interaction Field," IBM Systems J., 42(4):532--541, 2003.
[42]
I. McCowan, D. Gatica-Perez, S. Bengio, G. Lathoud, M. Barnard, and D. Zhang, "Automatic analysis of multimodal group actions in meetings," IEEE Trans. on PAMI, 27(3):305--317, 2005.
[43]
A. Cheyer and L. Julia, "MVIEWS: Multimodal tools for the video analyst," Conf. on Intelligent User Interfaces, 1998.
[44]
S.A. Brewster, J. Lumsden, M. Bell, M. Hall, and S. Tasker, "Multimodal 'Eyes-Free' interaction techniques for wearable devices," ACM CHI, 2003.
[45]
G. Fritz, C. Seifert, P. Luley, L. Paletta, and A. Almer, "Mobile vision for ambient learning in urban environments in urban environments," Int. Conf. on Mobile Learning, 2004.
[46]
J.B. Pelz, "Portable eye-tracking in natural behavior," J. of Vision, 4(11), 2004
[47]
Y. Kuno, N. Shimada, and Y. Shirai, "Look where you're going: A robotic wheelchair based on the integration of human and environmental observations," IEEE Robotics and Automation, 10(1):26--34, 2003.
[48]
P. Roth and T. Pun, "Design and evaluation of a multimodal system for the non-visual exploration of digital pictures," IN-TERACT 2003
[49]
M. Johnston and S. Bangalore, "Multimodal Applications from Mobile to Kiosk," W3C Workshop on Multimodal Interaction, 2002
[50]
J. Rehg, M. Loughlin, and K. Waters, "Vision for a Smart Kiosk," CVPR 1997, pp. 690--696. 1997
[51]
Q. Ji and X. Yang, "Real-time eye, gaze, and face pose tracking for monitoring driver vigilance," Real-Time Imaging, 8:357--377, 2002
[52]
P. Smith, M. Shah, and N.d.V. Lobo, "Determining driver visual attention with one camera," IEEE Trans. on Intelligent Transportation Systems, 4(4), 2003
[53]
A. Nijholt and D. Heylen, "Multimodal communication in inhabited virtual environments," Int. J. of Speech Technology 5:343--354, 2002
[54]
D. Maynes-Aminzade, R. Pausch, and S. Seitz, "Techniques for interactive audience participation," ICMI 2002
[55]
K.C. Wassermann, K. Eng, P.F.M.J. Verschure, and J. Manzolli, "Live soundscape composition based on synthetic emotions," IEEE Multimedia Magazine, 10(4), 2003
[56]
M.J. Lyons, M. Haehnel, and N. Tetsutani, "Designing, playing, and performing, with a vision-based mouth Interface," Conf. on New Interfaces for Musical Expression, 2003
[57]
J. Paradiso and F. Sparacino, "Optical tracking for music and dance performance," Optical 3-D Measurement Techniques IV, A. Gruen, H. Kahmen, eds., pp. 11--18, 1997
[58]
F. Sparacino, "The museum wearable: Real-time sensor-driven understanding of visitors' interests for personalized visually-augmented museum experiences," Museums and the Web, 2002
[59]
B. Shneiderman, Leonardo's Laptop: Human Needs and the New Computing Technologies, MIT Press, 2002.

Cited By

View all
  • (2023)Modelos y métodos computacionales para la crítica literaria: el estado del arteLiteratura: teoría, historia, crítica10.15446/lthc.v25n2.10878425:2Online publication date: 1-Jul-2023
  • (2023)A human cyber-physical system for human-centered computing in seafaringJournal of Ambient Intelligence and Humanized Computing10.1007/s12652-023-04598-614:6(7871-7884)Online publication date: 4-Apr-2023
  • (2023)Human-Centered Navigation Systems: A Systematic Literature ReviewProceedings of the 15th International Conference on Ubiquitous Computing & Ambient Intelligence (UCAmI 2023)10.1007/978-3-031-48306-6_27(268-274)Online publication date: 25-Nov-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MM '06: Proceedings of the 14th ACM international conference on Multimedia
October 2006
1072 pages
ISBN:1595934472
DOI:10.1145/1180639
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 October 2006

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. human-centered computing
  2. multimedia
  3. multimodal

Qualifiers

  • Article

Conference

MM06
MM06: The 14th ACM International Conference on Multimedia 2006
October 23 - 27, 2006
CA, Santa Barbara, USA

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)32
  • Downloads (Last 6 weeks)5
Reflects downloads up to 16 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2023)Modelos y métodos computacionales para la crítica literaria: el estado del arteLiteratura: teoría, historia, crítica10.15446/lthc.v25n2.10878425:2Online publication date: 1-Jul-2023
  • (2023)A human cyber-physical system for human-centered computing in seafaringJournal of Ambient Intelligence and Humanized Computing10.1007/s12652-023-04598-614:6(7871-7884)Online publication date: 4-Apr-2023
  • (2023)Human-Centered Navigation Systems: A Systematic Literature ReviewProceedings of the 15th International Conference on Ubiquitous Computing & Ambient Intelligence (UCAmI 2023)10.1007/978-3-031-48306-6_27(268-274)Online publication date: 25-Nov-2023
  • (2023)Human–Machine Computing: Paradigm, Challenges, and PracticesHandbook of Human‐Machine Systems10.1002/9781119863663.ch13(141-153)Online publication date: 7-Jul-2023
  • (2021)Human–machine computingCCF Transactions on Pervasive Computing and Interaction10.1007/s42486-020-00051-1Online publication date: 5-Jan-2021
  • (2021)Human Centered Computing in Digital Persona GenerationMultimedia Technology and Enhanced Learning10.1007/978-3-030-82565-2_32(385-401)Online publication date: 21-Jul-2021
  • (2021)Multimodal Context‐Sensitive Human Communication Interaction System Using Artificial Intelligence‐Based Human‐Centered ComputingHuman Communication Technology10.1002/9781119752165.ch6(137-161)Online publication date: 7-Nov-2021
  • (2020)Towards IoT-Aided Human–Robot Interaction Using NEP and ROS: A Platform-Independent, Accessible and Distributed ApproachSensors10.3390/s2005150020:5(1500)Online publication date: 9-Mar-2020
  • (2020)Predictive side decoding for human-centered multiple description image codingEURASIP Journal on Wireless Communications and Networking10.1186/s13638-020-01719-z2020:1Online publication date: 11-May-2020
  • (2020)The Future of False Information Detection on Social MediaACM Computing Surveys10.1145/339388053:4(1-36)Online publication date: 11-Jul-2020
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media