Contextual push-to-talk: shortening voice dialogs to improve driving performance

ABSTRACT

We present a driving simulator-based evaluation of a new technique for simplifying in-vehicle device interactions and thereby improving driver safety. We show that the use of multiple, contextually linked push-to-talk buttons (Multi-PTT) shortens voice dialog duration versus the use of a conventional, single push-to-talk button (Single-PTT). This benefit comes without detriment to driving performance or visual attention to the forward roadway. Test subjects also preferred the Multi-PTT approach over the conventional approach, and reported that it imposed a lower cognitive workload.

References

1. Alewine, N., Ruback, H., and Deligne, S. 2004. Pervasive Speech Recognition. IEEE Pervasive Computing 3, 4 (Oct. 2004), 78--81.
2. Alm, H., & Nilsson, L. (1994). Changes in driver behaviour as a function of hands-free mobile phones - A simulator study. Accident Analysis & Prevention, 26, 441--451.
3. Art Lebedev Studios. Optimus Mini Three. http://www.artlebedev.com/everything/optimus-mini, Retrieved 12 May, 2010.
4. Bach, K., Jæger, M., Skov, M. B., and Thomassen, N. 2008. You can touch, but you can't look: interacting with in-vehicle systems. In Proceedings of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy, April 05 - 10, 2008). CHI '08. ACM, New York, NY, 1139--1148. DOI= http://doi.acm.org/10.1145/1357054.1357233
5. Barón, A. and Green, P. (2006). Safety and Usability of Speech Interfaces for In-Vehicle Tasks while Driving: A Brief Literature Review. Technical Report UMTRI 2006-5. Ann Arbor, MI: University of Michigan Transportation Research Institute.
6. Chittaro, L. and De Marco, L. Driver Distraction Caused by Mobile Devices: Studying and Reducing Safety Risks. In Proceedings of the 1st Int'l Workshop Mobile Technologies and Health: Benefits and Risks (Udine, Italy, 2004).
7. D-Box GP PRO-200 RC, http://www.d-box.com/gaming/en/products/pro-gaming-series/gp-pro-200-rc/, Retrieved 12 May, 2010.
8. Divi, V., Forlines, C., Van Gemert, J., Raj, B., Schmidt-Nielsen, B., Wittenburg, K., Woelfel, J., Wolf, P., and Zhang, F. 2004. A speech-in list-out approach to spoken user interfaces. In Proceedings of HLT-NAACL 2004: Short Papers on XX (Boston, Massachusetts, May 02 - 07, 2004). Human Language Technology Conference. Association for Computational Linguistics, Morristown, NJ, 113--116.
9. Federal Register, Vol. 75, No. 17. FR Doc. 2010-1573 Filed 1-22-10. http://www.fmcsa.dot.gov/rules-regulations/administration/rulemakings/notices/Texting-by-Commercial-Motor-Vehicle.pdf. Retrieved 12 May, 2010.
10. Ford Sync, http://www.syncmyride.com/, Retrieved 12 May, 2010.
11. Forlines, C., Schmidt-Nielsen, B., Raj, B., Wittenburg, K., Wolf, P. A Comparison between Spoken Queries and Menu-based Interfaces for In-Car Digital Music Selection. In Proceedings IFIP TC13 International Conference on Human-Computer Interaction (September 12 - 16, 2005). INTERACT '05. Springer, Berlin, Germany, 536--549.
12. Garay-Vega, L., Pradhan, A.K., Weinberg, G., Schmidt-Nielsen, B., Harsham, B., Shen, Y., Divekar, G., Romoser, M., Knodler, M., Fisher, D.L. 2010. Evaluation of Different Speech and Touch Interfaces to In-Vehicle Music Retrieval Systems. Accident Analysis & Prevention, 42, 3 (May 2010), 913--920.
13. Graf, S., Spiessl, W., Schmidt, A., Winter, A., and Rigoll, G. 2008. In-car interaction using search-based user interfaces. In Proceedings of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy, April 05 - 10, 2008). CHI '08. ACM, New York, NY, 1685--1688. DOI= http://doi.acm.org/10.1145/1357054.1357317
14. Hart, S. G., & Staveland, L. E. 1988. Development of a multi-dimensional workload rating scale: Results of empirical and theoretical research. In P. A. Hancock & N. Meshkati (Eds.), Human Mental Workload, 139--183. Amsterdam, The Netherlands: Elsevier.
15. Image Space Incoporated, rFactor. http://www.rfactor.net/, Retrieved 12 May, 2010.
16. Itoh, K., Miki, Y., Yoshitsugu, N., Kubo, N., & Mashimo, S. 2004. Evaluation of a Voice-Activated System Using a Driving Simulator. SAE paper 2004-01-0232. Warrendale, PA: SAE.
17. Kun, A. L., Paek, T., Medenica, }., Memarovic, N., and Palinko, O. 2009. Glancing at personal navigation devices can affect driving: experimental results and design implications. In Proceedings of the 1st international Conference on Automotive User interfaces and interactive Vehicular Applications (Essen, Germany, September 21 - 22, 2009). AutomotiveUI '09. ACM, New York, NY, 129--136. DOI= http://doi.acm.org/10.1145/1620509.1620534
18. Palinko O., Kun A.L. 2008. Steering Wheel Sensor as a Push-To-Talk Solution. In Proceedings of the Fourth IET International Conference on Intelligent Environments (IE08), Seattle, WA, July 21--22, 2008.
19. rFactor Central, Coast Track 1.00, http://www.rfactorcentral.com/detail.cfm?ID=Coast%20Track, Retrieved 12 May, 2010.
20. Richtel, M. (2009). "Utah Gets Tough with Texting Drivers." New York Times, August 29, 2009. http://www.nytimes.com/2009/08/29/technology/29distracted.html, Retrieved 12 May, 2010.
21. Salvucci, D. D., Markley, D., Zuber, M., and Brumby, D. P. 2007. iPod distraction: effects of portable music-player use on driver performance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Jose, California, USA, April 28 - May 03, 2007). CHI '07. ACM, New York, NY, 243--250. DOI= http://doi.acm.org/10.1145/1240624.1240665
22. Seeing Machines faceLAB 5, http://www.seeingmachines.com/product/facelab/, Retrieved 12 May, 2010.
23. Sicconi, R., White, K. D., Ruback, H., Viswanathan, M., Eckhart, J., Badt, D., Morita, M., Satomura, M., Nagashima, N., Kondo, K. 2009. Honda Next Generation Speech User Interface. SAE World Congress & Exhibition, April 2009.
24. Strayer D. L., Drews, F. A., Crouch D. J. 2006. A Comparison of the Cell Phone Driver and the Drunk Driver. Journal of the Human Factors and Ergonomics Society, 48, 2 (2006), 381--391.
25. Texting While Driving PSA, http://www.youtube.com/watch?v=DGE8LzRaySk, Retrieved 12 May, 2010.
26. Walker, M. A., Borland J., Kamm, C. A. 1999. The utility of elapsed time as a usability metric for spoken dialogue systems. In Proceedings of the Sixth IEEE Workshop on Automatic Speech Recognition and Understanding. ASRU '99. 317--320.
27. Weinberg, G. 2009. Contextual push-to-talk: a new technique for reducing voice dialog duration. In Proceedings of the 11th international Conference on Human-Computer interaction with Mobile Devices and Services (Bonn, Germany, September 15 - 18, 2009). MobileHCI '09. ACM, New York, NY, 1--2. DOI= http://doi.acm.org/10.1145/1613858.1613960
28. Weinberg, G. and Harsham, B. 2009. Developing a low-cost driving simulator for the evaluation of in-vehicle technologies. In Proceedings of the 1st international Conference on Automotive User Interfaces and Interactive Vehicular Applications (Essen, Germany, September 21 - 22, 2009). AutomotiveUI '09. ACM, New York, NY, 51--54. DOI= http://doi.acm.org/10.1145/1620509.1620519
29. Wolf, P., Woelfel, J., van Gemert, J., Raj, B., and Wong, D. 2004. SpokenQuery: An Alternate Approach to Choosing Items with Speech. In Proceedings of the International Conference on Speech and Language Processing (Jeju Island, South Korea, October 4-8, 2004). ICSLP '04. ISCA, 2004, 221--224.

Index Terms

• Hardware

  • Communication hardware, interfaces and storage

    • Sound-based input / output

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction devices

      • Sound-based input / output

      • Touch screens