skip to main content
10.1145/1322192.1322210acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
poster

Towards smart meeting: enabling technologies and a real-world application

Published: 12 November 2007 Publication History

Abstract

In this paper, we describe the enabling technologies to develop a smart meeting system based on a three layered generic model. From physical level to semantic level, it consists of meeting capturing, meeting recognition, and semantic processing. Based on the overview of underlying technologies and existing work, we propose a novel real-world smart meeting application, called MeetingAssistant. It is distinctive from previous systems in two aspects. First it provides the real-time browsing that allows a participant to instantly view the status of the current meeting. This feature is helpful in activating discussion and facilitating human communication during a meeting. Second, the context-aware browsing adaptively selects and displays meeting information according to user's situational context, e.g., user purpose, which makes meeting viewing more efficient.

References

[1]
AMI project, http://www.amiproject.org/
[2]
D. Baron, et al, "Automatic punctuation and disfluency detection in multi-party meetings using prosodic and lexical cues", In Proc. ICSLP2002, Denver, Colorado, USA, September 2002, pp. 949--952.
[3]
H. Bounif, et al, "A Multimodal Database Framework for Multimedia Meeting Annotations", In proc. of the International Conference on Multi-Media Modeling (MMM'04), January 5--7, 2004, Australia, pp. 17--25.
[4]
C. Busso, S. Hernanz, C. W. Chu, S. Kwon, S. Lee, P.G. Georgiou, I. Cohen, and S. Narayanan, "Smart Room: Participant and Speaker Localization and Identification", In Proc. of 2005 International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2005), Philadelphia, PA, March 18--23, 2005, vol. 2, pp. 1117--1120.
[5]
P. Chiu, et al, "Room with a Rear View: Meeting Capture in a Multimedia Conference Room", IEEE Multimedia, Vol. 7 No. 4, October 2000, pp. 48--54.
[6]
S. Colbath, and F. Kubala, "Rough'n'Ready: A Meeting Recorder and Browser", In Proc. of the Perceptual User Interface Conference, San Francisco, CA, November 4--6, 1998, pp. 220--223.
[7]
R. Cutler, Y. Rui, A. Gupta, J.J. Cadiz, I. Tashev, L. He, A. Colburn, Z. Zhang, Z. Liu, and S. Silverberg, "Distributed Meetings: A Meeting Capture and Broadcasting System", In Proc. of the 10th ACM Conference on Multimedia, Juan-les-Pins, France, December 1-6, 2002, pp. 503--512.
[8]
A. K. Dey, D. Salber, G. D. Abowd, and M. Futakawa, "The Conference Assistant: Combining Context-Awareness with Wearable Computing", In Proc. of the 3rd International Symposium on Wearable Computers (ISWC'99), October 18--19, 1999, San Francisco, CA, pp. 21--28.
[9]
A. Dielmann and S. Renals, "Dynamic Bayesian Networks for Meeting Structuring", in Proc. IEEE ICASSP 2004, Montreal, Canada, May 17--21, 2004, pp. 629--632.
[10]
J. Foote, and D. Kimber, "FlyCam: Practical Panoramic Video and Automatic Camera Control", Proc. of ICME 2000, July 30 -- August 2, 2000, New York, USA, pp. 1419--1422.
[11]
D. Gatica-Perez, et al, "On automatic annotation of meeting databases", Prof. of Int. Conf. on Image Processing (ICIP 2003), Barcelona, Spain, September 14--18, 2003, vol. 3, pp. 629--632.
[12]
D. Gatica-Perez, et al, "Detecting Group Interest-Level in Meetings", in Proc. Of IEEE ICASSP 2005, Philadelphia, PA, March 18--23, 2005, vol. 1, pp. 489--492.
[13]
W. Geyer, et al, "Making Multimedia Meeting Records More Meaningful", in Proc. of the IEEE International Conference on Multimedia and Expo (ICME 2003), Baltimore, MD, July 6--9, 2003, vol. 2, pp. 669--672.
[14]
R. Gross, J. Yang, and A. Waibel, "Face Recognition in a Meeting Room", in Proc. of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition, Grenoble, France, March 26--30, 2000, pp. 294--299.
[15]
D. Hillard, M. Ostendorf, and E. Shriberg, "Detection of Agreement vs. Disagreement in Meetings: Training with Unlabeled Data", Human Language Technology and North American Chapter of the Association for Computational Linguistics Conference (HLT--NAACL), May 27--June 1, 2003, Edmonton, Canada, vol. Comp., pp 34--36.
[16]
A. Jaimes, et al, "Memory Cues for Meeting Video Retrieval", The first ACM Workshop on Continuous Archival and Retrieval of Personal Experiences (CARPE'04), New York, NY, USA, October 15, 2004, pp. 74--85.
[17]
A. Jaimes and J. Miyazaki, "Building a Smart Meeting Room: From Infrastructure to the Video Gap (Research and Open Issues)", the 21st International Conference on Data Engineering Workshops (ICDEW 05), Tokyo, Japan, April 5--8, 2005, pp. 1173--1182.
[18]
R. Jain, P. Kim, and Z. Li, "Experintial Meeting Systems", in Proc. of ACM Workshop on Experiential TelePresence, Berkeley, California, USA, November 7, 2003, pp. 1--12.
[19]
J. Kaplan, "Next-Generation Conference Rooms", Ubicomp 2005 Workshop on ubiquitous computing in next generation conference rooms, September 11--14, 2005, Tokyo, Japan.
[20]
L. Kennedy and D. Ellis, "Laughter Detection in Meetings", NIST ICASSP 2004 Meeting Recognition Workshop, Montreal, Canada, 2004, pp. 118--121.
[21]
N. Kern, et al, "Wearable Sensing to Annotate Meeting Recordings", Personal and Ubiquitous Computing, vol. 7, no. 5, October 2003, pp. 263--274.
[22]
H. Koiso, Y. Horiuchi, S. Tutiya, A. Ichikawa, and Y. Den, "An analysis of turn-taking and backchannels based on prosodic and syntactic features in Japanese Map Task dialogues", Language and Speech, 41, 1998, 295--321.
[23]
D. Lee, B. Erol, J. Graham, J. J. Hull, and N. Murata, "Portable Meeting Recorder", in Proc. of the 10th ACM Conference on Multimedia, Juan-les-Pins, France, December 1-6, 2002, pp. 493--502.
[24]
Z. Liu, et al, "Energy-based Sound Source Localization and Gain Normalization for Ad Hoc Microphone Arrays", in Proc. of ICASSP07, Hawaii, April 15--20, 2007
[25]
M. Liwicki, et al, "Writer Identification for Smart Meeting Room Systems", in Proc. of 7th IAPR Workshop on Document Analysis Systems, February 2006, Nelson, New Zealand, pp. 186--195.
[26]
Mboss, http://www.mboss.force9.co.uk/
[27]
I. McCowan, et al, "Automatic Analysis of Multimodal Group Actions in Meetings", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 27, No. 3, March 2005, pp. 305--317.
[28]
I. Mikic and K. Huang and Mohan M. Trivedi, "Activity Monitoring and Summarization for an Intelligent Meeting Room", IEEE Workshop on Human Motion, Austin, Texas, December 2000, pp. 107--112.
[29]
Mimio, http://www.mimio.com/
[30]
H. Nait-Charif and S. J. McKenna, "Head Tracking and Action Recognition in a Smart Meeting Room", the IEEE International Workshop on Performance Evaluation of Tracking and Surveillance, Graz, Austria, March 31, 2003, pp. 24--31.
[31]
D. Reidsma, et al, "Meeting Modelling in the Context of Multimodal Research", Proc. of the First International Workshop on Machine Learning for Multimodal Interaction (MLMI'04), Switzerland, June 21--23, 2004, pp. 22--35.
[32]
S. Renals and D. Ellis, "Audio Information Access from Meeting Rooms", In Proc. of IEEE ICASSP 2003, Hong Kong, April 6--10, 2003, Vol. 4, pp. 744--747.
[33]
Y. Rui, et al, "Viewing Meetings Captured by an Omni-Directional Camera", Proc. of ACM CHI 2001, Seattle, WA, March 31-April 5, 2001, pp. 450--457.
[34]
R. Stiefelhagen, J. Yang, and A. Waibel, "Modeling Focus of Attention for Meeting Indexing", ACM Multimedia 1999, Orlando, Florida, October 30 -- November 5, 1999, pp. 3--10.
[35]
R. Stiefelhagen and J. Zhu, "Head Orientation and Gaze Direction in Meetings", In Proc. Of Conference on Human Factors in Computing Systems (CHI 2002), Minneapolis, Minnesota, USA, April 20--25, 2002, pp. 858--859.
[36]
R. Stiefelhagen, "Tracking Focus of Attention in Meetings", The Fourth IEEE International Conference on Multimodal Interfaces (ICMI 2002), October 14-16, 2002, Pittsburgh, PA, USA, pp. 273--280.
[37]
M. Trivedi, I. Mikic, and S. Bhonsle, "Active Camera Networks and Semantic Event Databases for Intelligent Environments", IEEE Workshop on Human Modeling, Analysis and Synthesis (in conjunction with CVPR), Hilton Head, South Carolina, June 2000.
[38]
S. Tucker and S. Whittaker, "Accessing Multimodal Meeting Data: Systems, Problems and Possibilities", Workshop on Multimodal Interaction and Related Machine Learning Algorithms, Martigny, Switzerland, June 21--23, 2004, pp. 1--11.
[39]
M. Turk and A. Pentland, "Eigenfaces for recognition", Journal of Cognitive Neuroscience, 3(1), 1991, pp. 71--86.
[40]
A. Waibel, M. Bett, and M. Finke, "Meeting Browser: Tracking and Summarizing Meetings", Proc. of the Broadcast News Transcription and Understanding Workshop, Lansdowne, Virginia, February 1998, pp. 281--286.
[41]
A. Waibel, et al, "Advances in Automatic Meeting Record Creation and Access", Proc. of the International Conference on Acoustics, Speech, and Signal Processing, May 7--11, 2001, Salt Lake City, Utah, USA, pp. 597--600.
[42]
P. Wellner, M. Flynn, and M. Guillemot, "Browsing Recorded Meetings with Ferret", Proc. of the First International Workshop on Machine Learning for Multimodal Interaction (MLMI'04), Martigny, Switzerland, June 21--23, 2004, pp. 12--21.
[43]
B. Wrede and E. Shriberg, "Spotting 'Hot Spots' in Meetings: Human Judgments and Prosodic Cues", in Proc. European Conf. on Speech Communication and Technology, Geneva, Switzerland, September 1--4, 2003, pp. 2805--2808.
[44]
B. Wrede and E. Shriberg, "The Relationship between Dialogue Acts and Hot Spots in Meetings", in Proc. IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), Virgin Islands, November 30--December 3, 2003, pp. 180--185.
[45]
J. Yang, X. Zhu, R. Gross, J. Kominek, Y. Pan, and A. Waibel, "Multimodal People ID for a Multimedia Meeting Browser", Proc. of ACM Multimedia 99, October 30-November 5, 1999, Orlando, FL, USA, pp. 159--168.
[46]
H. Yu, et al, "Progress in Automatic Meeting Transcription", Proc. of 6th European Conference on Speech Communication and Technology (Eurospeech--99), Budapest, Hungary, September 5--9, 1999, Vol. 2, pp. 695--698.
[47]
M. Zobl, et al, "Action Recognition in Meeting Scenarios Using Global Motion Features", In Proc. of IEEE Intl. Workshop on Performance Evaluation of Tracking and Surveillance (PETS--CCVS), Austria, March 2003, pp. 32--36.

Cited By

View all
  • (2020)A Robust Tracking-by-Detection Algorithm Using Adaptive Accumulated Frame Differencing and Corner FeaturesJournal of Imaging10.3390/jimaging60400256:4(25)Online publication date: 21-Apr-2020
  • (2018)MeetingVis: Visual Narratives to Assist in Recalling Meeting Context and ContentIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2018.281620324:6(1918-1929)Online publication date: 1-Jun-2018
  • (2015)Biometric-Based User Authentication and Activity Level Detection in a Collaborative EnvironmentTransparency in Social Media10.1007/978-3-319-18552-1_9(165-180)Online publication date: 2015
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ICMI '07: Proceedings of the 9th international conference on Multimodal interfaces
November 2007
402 pages
ISBN:9781595938176
DOI:10.1145/1322192
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 November 2007

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. context-aware
  2. meeting browser
  3. real-time
  4. smart meeting

Qualifiers

  • Poster

Conference

ICMI07
Sponsor:
ICMI07: International Conference on Multimodal Interface
November 12 - 15, 2007
Aichi, Nagoya, Japan

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)5
  • Downloads (Last 6 weeks)2
Reflects downloads up to 09 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2020)A Robust Tracking-by-Detection Algorithm Using Adaptive Accumulated Frame Differencing and Corner FeaturesJournal of Imaging10.3390/jimaging60400256:4(25)Online publication date: 21-Apr-2020
  • (2018)MeetingVis: Visual Narratives to Assist in Recalling Meeting Context and ContentIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2018.281620324:6(1918-1929)Online publication date: 1-Jun-2018
  • (2015)Biometric-Based User Authentication and Activity Level Detection in a Collaborative EnvironmentTransparency in Social Media10.1007/978-3-319-18552-1_9(165-180)Online publication date: 2015
  • (2014)A Smart Meeting Management System With Video Based Seat DetectionProceedings of International Conference on Internet Multimedia Computing and Service10.1145/2632856.2632874(232-236)Online publication date: 10-Jul-2014
  • (2014)Various mining techniques defined for mining product valuation instances in market basket data2014 International Conference on Green Computing Communication and Electrical Engineering (ICGCCEE)10.1109/ICGCCEE.2014.6921407(1-6)Online publication date: Mar-2014
  • (2012)Tree-Based Mining for Discovering Patterns of Human Interaction in MeetingsIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2010.22424:4(759-768)Online publication date: 1-Apr-2012
  • (2012)Probabilistic Speaker Diarization With Bag-of-Words Representations of Speaker Angle InformationIEEE Transactions on Audio, Speech, and Language Processing10.1109/TASL.2011.215185820:2(447-460)Online publication date: 1-Feb-2012
  • (2011)An efficient and scalable meeting minutes generation and presentation techniqueProceedings of the 1st international conference on Human interface and the management of information: interacting with information - Volume Part II10.5555/2021604.2021648(345-352)Online publication date: 9-Jul-2011
  • (2011)An Efficient and Scalable Meeting Minutes Generation and Presentation TechniqueHuman Interface and the Management of Information. Interacting with Information10.1007/978-3-642-21669-5_41(345-352)Online publication date: 2011
  • (2010)Smart meeting systemsACM Computing Surveys10.1145/1667062.166706542:2(1-20)Online publication date: 5-Mar-2010
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media