skip to main content
10.1145/1111449.1111469acmconferencesArticle/Chapter ViewAbstractPublication PagesiuiConference Proceedingsconference-collections
Article

Automatic prediction of misconceptions in multilingual computer-mediated communication

Published: 29 January 2006 Publication History

Abstract

Multilingual communities using machine translation to overcome language barriers are showing up with increasing frequency. However, when a large number of translation errors get mixed into conversations, users have difficulty completely understanding each other. In this paper, we focus on misconceptions found in high volume in actual online conversations using machine translation. We first examine the response patterns in machine translation-mediated communication and associate them with misconceptions. Analysis results indicate that response messages to include misconceptions posted via machine translation tend to be incoherent, often focusing on short phrases of the original message. Next, based on the analysis results, we propose a method that automatically predicts the occurrence of misconceptions in each dialogue. The proposed method assesses the tendency of each dialogue including misconceptions by calculating the gaps between the regular discussion thread (syntactic thread) and the discussion thread based on lexical cohesion (semantic thread). Verification results show significant positive correlation between actual misconception frequency and gaps between syntactic and semantic threads, which indicate the validity of the method.

References

[1]
Aiken, M., Hwang, C., Paolillo, J. and Lu, L. A group decision support system for the Asian Pacific rim. Journal of International Information Management, 3, 1994, 1--13.
[2]
Aiken, M. Multilingual Communication in Electronic Meetings. ACM SIGGROUP, Bulletin, 23, 1, 2002.
[3]
Blakar, R. Toward a theory of communication in terms of preconditions: A conceptual framework and some empirical explorations. Recent Advances in Language, Communication, and Social Psychology, 1985, 10--40.
[4]
Churchill, E. F. and Bly, S. Cultural Vultures: Considering Culture and Communication in Virtual Environments. Proceedings of ACM SIGGROUP, 21, 1, 2000.
[5]
Clark, H. H. and Marshall, C. E. Definite reference and mutual knowledge. Elements of discourse understanding, 1981, 10--63.
[6]
Clark, H. H. and Wilkes-Gibbs, D. Referring as a collaborative process. Cognition, 22, 1986, 1--39.
[7]
Clark, H. H. and Brennan, S. E., Grounding in communication. Perspectives on socially shared cognition, 1991, 127--149.
[8]
Climent, S., More, J., Oliver, A., Salvatierra, M., Sanchez, I., Taule, M. and Vallmanya, L. Bilingual Newsgroups in Catalonia: A Challenge for Machine Translation. Journal of Computer Mediated Communication, 9, 1, 2003.
[9]
Danet, B. and Herring, S.C. Introduction: The Multilingual Internet, Journal of Computer Mediated Communication, vol. 9, no. 1, 2003.
[10]
Doherty-Sneddon, G., Anderson, A. H., O'Malley, C., Langton, S., Garrod, S. and Bruce, V. Face-to-face and video mediated communication: a comparison of dialogue structure and task performance. Journal of Experimental Psychology: Applied, 3, 1997, 105--125.
[11]
Donath, J. A Semantic Approach to Visualizing Online Conversations. Communications of the ACM, 45, 4, 2002.
[12]
Fussell, S. R. and Krauss, R. M. Coordination of knowledge in communication: Effects of speakers' assumptions about what others know. Journal of Personality and Social Psychology, 62, 1992, 378--391.
[13]
Fussell, S. R., Kraut, R. E. and Siegel, J. Coordination of communication: Effects of shared visual context on collaborative work, Proceedings of CSCW, ACM Press, 2000, 21--30.
[14]
Halliday, M.A.K. and Hasan, R. Cohesion in English, Longman, London, 1976.
[15]
Herring, S. C. Interactional Coherence in CMC, Proceedings of the Hawaii International Conference on Systems Sciences, 1999.
[16]
Kim, K.J. and Bonk, C.J. Cross-Cultural Comparisons of Online Collaboration. Journal of Computer Mediated Communication, 8, 1, 2002.
[17]
Kraut, R. E., S. Lewis, S., and Swezey, L. Listener responsiveness and the coordination of conversation. Journal of Personality and Sociological Psychology, 43, 1982, 718--731.
[18]
Lewis, D. D. and Knowles, K. A. Threading Electronic Mail: A Preliminary Study. Info. Proceeding and Management, 33, 1, Elsevier, 1997, 209--217.
[19]
McDaniel, S., Olson, G., and Magree, J. Identifying and analyzing multiple threads in computer-mediated and face-to-face conversations. Proceedings of CSCW, ACM Press, 1996, 39--47.
[20]
Newman, P. Exploring discussion lists: Steps and directions. Proceedings of JCDL 2002, ACM Press, 2002, 126--134.
[21]
Rogers, Y. Ghosts in the Network: Distributed Troubleshooting in a Shared Working Environment. Proceedings of CSCW, ACM Press, 1992.
[22]
Rogers, Y. Coordinating computer-mediated work, Computer Supported Cooperative Work, vol. 1, pp. 295--315, 1993.
[23]
Takano, Y. and Noda, A. A temporary decline of thinking ability during foreign language processing. Journal of Cross-Cultural Psychology, 24, 1993, 445--462.
[24]
Tung, L. L. and Quaddus, M. A. Cultural differences explaining the differences in results in GSS: implications for the next decade. Decision Support Systems, 33, 2, 2002, 177--199.
[25]
Yamauchi, Y., Yokozawa, M., Shinohara, T. and Ishida, T. Collaboration with Lean Media: How Open-Source Software Succeeds. Proceedings of CSCW, ACM Press, 2000, 329--338.
[26]
Grice, H. P. Logic and conversation. In Cole, P. and Morgan, 1975, 41--58.
[27]
Ohno, F, Hamanishi, T, Kadokawa Thesaurus, Kadokawa Shoten, 1981.
[28]
Schegloff, E. A. and Sacks, H. Opening up closings. Semotica, 8, 1973, 289--327.
[29]
Yoshida, Y. and Ohga, J. Effect of S/N ratio on comfortableness of telephone dialog. Acoustic Conference, 2004.

Cited By

View all
  • (2022)Understanding and Being Understood: User Strategies for Identifying and Recovering From Mistranslations in Machine Translation-Mediated ChatProceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency10.1145/3531146.3534638(2223-2238)Online publication date: 21-Jun-2022
  • (2021)Predicting Success of a Persuasion through Joint Modeling of Utterance CategorizationProceedings of the 30th ACM International Conference on Information & Knowledge Management10.1145/3459637.3482160(3423-3427)Online publication date: 26-Oct-2021
  • (2018)Beyond TranslationProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173791(1-12)Online publication date: 21-Apr-2018
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
IUI '06: Proceedings of the 11th international conference on Intelligent user interfaces
January 2006
392 pages
ISBN:1595932879
DOI:10.1145/1111449
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 January 2006

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. computer-mediated communication
  2. machine translation
  3. misconception
  4. multilingual groups

Qualifiers

  • Article

Conference

IUI06
IUI06: 11th International Conference on Intelligent User Interfaces
January 29 - February 1, 2006
Sydney, Australia

Acceptance Rates

Overall Acceptance Rate 746 of 2,811 submissions, 27%

Upcoming Conference

IUI '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)11
  • Downloads (Last 6 weeks)0
Reflects downloads up to 23 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2022)Understanding and Being Understood: User Strategies for Identifying and Recovering From Mistranslations in Machine Translation-Mediated ChatProceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency10.1145/3531146.3534638(2223-2238)Online publication date: 21-Jun-2022
  • (2021)Predicting Success of a Persuasion through Joint Modeling of Utterance CategorizationProceedings of the 30th ACM International Conference on Information & Knowledge Management10.1145/3459637.3482160(3423-3427)Online publication date: 26-Oct-2021
  • (2018)Beyond TranslationProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173791(1-12)Online publication date: 21-Apr-2018
  • (2015)Evaluation of the Validity of Back-Translation as a Method of Assessing the Accuracy of Machine TranslationProceedings of the 2015 International Conference on Culture and Computing (Culture Computing)10.1109/Culture.and.Computing.2015.35(145-150)Online publication date: 17-Oct-2015
  • (2014)How beliefs about the presence of machine translation impact multilingual collaborationsProceedings of the 17th ACM conference on Computer supported cooperative work & social computing10.1145/2531602.2531702(1549-1560)Online publication date: 15-Feb-2014
  • (2014)Translation Agent: A New Metaphor for Machine TranslationNew Generation Computing10.1007/s00354-014-0204-032:2(163-186)Online publication date: 3-May-2014
  • (2013)Same translation but different experienceProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/2470654.2470719(449-458)Online publication date: 27-Apr-2013
  • (2013)Agent metaphor for machine translation mediated communicationProceedings of the 2013 international conference on Intelligent user interfaces10.1145/2449396.2449407(67-74)Online publication date: 19-Mar-2013
  • (2011)Features of Accuracy Mismatch between Back-Translated Sentences and Target-Translated SentencesProceedings of the 2011 Second International Conference on Culture and Computing10.1109/Culture-Computing.2011.20(63-68)Online publication date: 20-Oct-2011
  • (2011)Intercultural Collaboration Tools Based on the Language GridThe Language Grid10.1007/978-3-642-21178-2_3(35-49)Online publication date: 16-Jul-2011
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media