Talking your way around a conference: a speech interface for remote equipment control

ABSTRACT

Videoconferencing enables people to attend and participate in meetings from remote locations. The key problem faced by electronic attendees is the limited sense of engagement offered by the audio-visual channel. The attendee is typically restricted to a single view of the room and has no ability to interact with presentation technology at the conference site.As a first step to improving the situation we want to assign electronic attendees a view of the room appropriate to their particular "social roles," which may include presenting a topic, listening to a talk, or participating in a discussion. However, attendees may change roles during a meeting, thus requiring a different position and view more suited to the new role. This involves switching video inputs and outputs to new cameras and monitors.One possible method to enable video attendees to effect these changes independently is to provide them with the same graphical user interface (GUI) that the central site has to control the equipment. Unfortunately, using state-of-the-art systems for such control is often confusing and complex. Furthermore, this solution requires the attendees to have "extra" computer equipment (i.e. equipment not already required for videoconferencing) and learn how to operate the GUI.Instead, using speech recognition and video overlay technologies, we are able to provide a non-technical interface to equipment in the meeting room. In doing so, we do not require any extra equipment at the attendees' sites. Our approach provides attendees with the means of controlling their own view of the meeting, changing electronic seats, and manipulating equipment remotely, all through simple voice commands.

References

1. {1} Buxton, W. and Moran, T. EuroPARC's Integrated Interactive Intermedia Facility (iiif): Early Experience, In S. Gibbs & A.A. Verinj-Stuart (Eds.). Multi-user interfaces and applications, Proceedings of the IFIP WG 8.4 Conference on Multi-user Interfaces and Applications, Heraklion, Crete. Amsterdam: Elsevier Science Publishers B.V. (North-Holland), pages 11-34, 1990.
2. {2} Cooperstock, J., Tanikoshi, K., and Buxton, W. Turning Your Video Monitor into a Virtual Window, Proc. of IEEE PACRIM, Pacific Rim Conference on Communications, Computers, Visualization and Signal Processing, Victoria, May 1995.
3. {3} Cooperstock, J., Tanikoshi, K., Beirne, G., Narine, T., and Buxton, W. Evolution of a Reactive Environment. Proceedings of CHI'95, Denver, Colorado, May 1995.
4. {4} Daya, S., Hyper Doorway - Controlling a remote system over a video link, Computer Engineering Undergraduate Thesis, University of Toronto, April 1995.
5. {5} Gaver, W. The affordances of media spaces for collaboration. Proceedings of CSCW'92.
6. {6} Gaver, W., Smets, G., and Overbeeke, C. (1995). A Virtual Window on Media Space. Proceedings of CHI'95, Denver Colorado.
7. {7} Riesenbach, R. The Ontario Telepresence Project, CHI'94 Conference Companion, pages 173-174.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Natural language processing

      • Speech recognition

• Hardware

  • Communication hardware, interfaces and storage

    • Sound-based input / output

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction devices

      • Sound-based input / output

• Information systems

  • World Wide Web

    • Web applications

      • Internet communications tools

        • Web conferencing