skip to main content
10.1145/1526993.1527003acmconferencesArticle/Chapter ViewAbstractPublication PagesthewebconfConference Proceedingsconference-collections
research-article

The effects of source credibility ratings in a cultural heritage information aggregator

Published: 20 April 2009 Publication History

Abstract

State of the art web search applications allow the user to aggregate information from many sources. Because of this, users are confronted with having to assess the reliability of information from different sources. This paper reports on an empirical user study on the effect of displaying credibility ratings of multiple cultural heritage sources (e.g. museum websites, art blogs) on users' search performance and selection. The study investigated whether source credibility has an in uence on users' search performance when they are confronted with only a few information sources or where there are many. The results of our online interactive study (n=122) show that by presenting the source credibility information explicitly, people's confidence in their selection of information significantly increases, even though it does not necessarily make search more time efficient. Additionally, we highlight credibility issues that are applicable beyond the cultural heritage domain, such as issues related to credibility measures and choice of visualization.

References

[1]
A. Amin, J. van Ossenbruggen, L. Hardman, and A. van Nispen. Understanding cultural heritage experts' information seeking needs. In Proc. JCDL '08, pages 39--47, New York, NY, USA, 2008. ACM.
[2]
D. K. Berlo, J. B. Lemert, and R. J. Mertz. Dimensions for Evaluating the Acceptability of Message Sources. Public Opin Q, 33(4):563--576, 1970.
[3]
W. P. Cassidy. Online news credibility: An examination of the perceptions of newspaper journalists. Journal of Computer-Mediated Communication, 12(2):478--498, 2007.
[4]
T. Chesney. An empirical examination of wikipedia's credibility. First Monday, 11(11), Nov. 2006.
[5]
J. H. Choi, J. H. Watt, and M. Lynch. Perceptions of news credibility about the war in iraq: Why war opponents perceived the internet as the most credible medium. Journal of Computer-Mediated Communication, 12(1):209--229, 2006.
[6]
M. Craigie, B. Loader, R. Burrows, and S. Muncer. Reliability of health information on the internet: An examination of experts' ratings. J Med Internet Res, 4(1):2, Jan 2002.
[7]
H. Cramer, V. Evers, S. Ramlal, M. Someren, L. Rutledge, N. Stash, L. Aroyo, and B. Wielinga. The e ffects of transparency on trust in and acceptance of a content-based art recommender. User Modeling and User-Adapted Interaction, 18(5):455--496, 2008.
[8]
W. Du, B. Craig, and J. Cherry. Historians' use of archival sources: Promises and pitfalls of the digital age. Public Historian, 26(2):7--22, 2004.
[9]
M. S. Eastin. Credibility assessments of online health information: The effnects of source expertise and knowledge of content. Journal of Computer-Mediated Communication, 6(4):0{0, 2001.
[10]
Eero Hyvonen, et al. Culturesampo -- finnish cultural heritage collections on the semantic web 2.0. In Proc. of the 1st International Symposium on Digital humanities for Japanese Arts and Cultures (DH-JAC-2009), Ritsumeikan, Kyoto, Japan, March 2009.
[11]
G. Eysenbach and C. Kohler. How do consumers search for and appraise health information on the world wide web? Qualitative study using focus groups, usability tests, and in-depth interviews. BMJ, 324(7337):573--577, 2002.
[12]
K. N. Fachry and J. Kamps and J. Zhang Access to archival material in context. In Proc. of the second international symposium on Information interaction in context (IIiX '08), pages 102--109, New York, NY, USA, 2008. ACM.
[13]
A. J. Flanagin and M. J. Metzger. The role of site features, user attributes, and information verification behaviors on the perceived credibility of web-based information. New Media Society, 9(2):319--342, 2007.
[14]
B. J. Fogg and H. Tseng. The elements of computer credibility. In Proc. CHI '99, pp. 80{87, ACM.
[15]
W. E. Hick. On the rate of gain of information. The Quarterly Journal of Experimental Psychology, 4(1):11--26, 1952.
[16]
T. Hong. The influence of structural and message features on web site credibility. J. Am. Soc. Inf. Sci. Technol., 57(1):114--127, 2006.
[17]
Hovland, Carl I. and Weiss, Walter. The influence of source credibility on communication e ffectiveness. The Public Opinion Quarterly, 15(4):635--650, 1951.
[18]
S. Kiousis. Public trust or mistrust? perceptions of media credibility in the information age. Mass Communication & Society, 4(4):381--403, 2001.
[19]
J. Koenemann and N. J. Belkin. A case for interaction: a study of interactive information retrieval behavior and e ectiveness. Proc. of the SIGCHI conference on Human factors in computing systems, pages 205--212, New York, NY, USA, 1996. ACM.
[20]
D. A. B. Lindberg and B. L. Humphreys. Medicine and Health on the Internet: The Good, the Bad, and the Ugly. JAMA, 280(15):1303--1304, 1998.
[21]
R. Lopes and L. Carrifico. On the credibility of wikipedia: an accessibility perspective. In Proc. WICOW '08, pp. 27--34, 2008. ACM.
[22]
M. J. Metzger, A. J. Flanagin, and L. Zwarun. College student web use, perceptions of information credibility, and verification behavior. Comput. Educ., 41(3):271--290, 2003.
[23]
V. Murdock and M. Lalmas. Workshop on aggregated search. SIGIR Forum, 42(2):80--83, 2008. ACM.
[24]
G. Peterson, P. Aslani, and A. K. Williams. How do consumers search for and appraise information on medicines on the internet? a qualitative study using focus groups. J Med Internet Res, 5(4):e33, Dec 2003.
[25]
S. Y. Rieh and D. R. Danielson. Credibility: A multidisciplinary framework. In Annual Review of Information Science and Technology, pp. 307--364, 2007.
[26]
G. Schreiber, A. Amin, M. van Assem, V. de Boer, L. Hardman, M. Hildebrand, L. Hollink, Z. Huang, J. van Kersen, M. de Niet, B. Omelayenko, J. van Ossenbruggen, R. Siebes, J. Taekema, J. Wielemaker, and B. Wielinga. Multimedian e-culture demonstrator. In Proc. ISWC 2006, vol. 4273 of LNCS, pages 951--958. Springer, 2006.
[27]
S. S. Sundar and C. Nass. Conceptualizing sources in online news. Journal of Communication, 51(1):52--72, 2001.
[28]
S. Tseng and B. J. Fogg. Credibility and computing technology. Commun. ACM, 42(5):39{44, 1999.
[29]
Y. Tsfati and J. N. Cappella. Why do people watch news they do not trust? the need for cognition as a moderator in the association between news media skepticism and exposure. Media Psychology, 7(3):251--271, 2005.
[30]
B. J. Walther, Z. Wang, and T. Loh. The effect of top-level domains and advertisements on health web site credibility. J Med Internet Res, 6(3), Sep 2004.
[31]
J. Zhang, K. N. Fachry, and J. Kamps. Access to archival finding aids: Context matters. In Proc. ECDL '08, pages 455--457, Berlin, Heidelberg, 2008. Springer-Verlag.

Cited By

View all
  • (2021)Digital Targeted Communication: An Integrated ApproachDigital Transformation in the Cultural Heritage Sector10.1007/978-3-030-63376-9_10(199-219)Online publication date: 26-Mar-2021
  • (2016)Trust Necessitated through Metrics: Estimating the Trustworthiness of WebsitesProcedia Computer Science10.1016/j.procs.2016.05.19985(133-140)Online publication date: 2016
  • (2016)How to Support the Lay Users Evaluations of Medical Information on the Web?Human Interface and the Management of Information: Information, Design and Interaction10.1007/978-3-319-40349-6_1(3-13)Online publication date: 21-Jun-2016
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
WICOW '09: Proceedings of the 3rd workshop on Information credibility on the web
April 2009
84 pages
ISBN:9781605584881
DOI:10.1145/1526993
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 April 2009

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. credibility
  2. cultural heritage
  3. user study

Qualifiers

  • Research-article

Conference

WWW '09
Sponsor:

Acceptance Rates

WICOW '09 Paper Acceptance Rate 9 of 19 submissions, 47%;
Overall Acceptance Rate 9 of 19 submissions, 47%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)13
  • Downloads (Last 6 weeks)2
Reflects downloads up to 14 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2021)Digital Targeted Communication: An Integrated ApproachDigital Transformation in the Cultural Heritage Sector10.1007/978-3-030-63376-9_10(199-219)Online publication date: 26-Mar-2021
  • (2016)Trust Necessitated through Metrics: Estimating the Trustworthiness of WebsitesProcedia Computer Science10.1016/j.procs.2016.05.19985(133-140)Online publication date: 2016
  • (2016)How to Support the Lay Users Evaluations of Medical Information on the Web?Human Interface and the Management of Information: Information, Design and Interaction10.1007/978-3-319-40349-6_1(3-13)Online publication date: 21-Jun-2016
  • (2015)Credibility in Information RetrievalFoundations and Trends in Information Retrieval10.1561/15000000469:5(355-475)Online publication date: 1-Dec-2015
  • (2014)Determinants of E-WOM influenceJournal of Theoretical and Applied Electronic Commerce Research10.4067/S0718-187620140001000049:1(28-43)Online publication date: 1-Jan-2014
  • (2014)Providing Web Credibility Assessment SupportProceedings of the 2014 European Conference on Cognitive Ergonomics10.1145/2637248.2637260(1-8)Online publication date: 1-Sep-2014
  • (2014)Credibility MicroscopeProceedings of the 2014 IEEE/WIC/ACM International Joint Conferences on Web Intelligence (WI) and Intelligent Agent Technologies (IAT) - Volume 0110.1109/WI-IAT.2014.47(297-302)Online publication date: 11-Aug-2014
  • (2013)Computational trust assessment of open media data2013 IEEE International Conference on Multimedia and Expo Workshops (ICMEW)10.1109/ICMEW.2013.6618392(1-6)Online publication date: Jul-2013
  • (2012)Social health data integration using semantic WebProceedings of the 27th Annual ACM Symposium on Applied Computing10.1145/2245276.2245351(392-397)Online publication date: 26-Mar-2012
  • (2011)Credibility of web applicationsProceedings of the International Conference on Management of Emergent Digital EcoSystems10.1145/2077489.2077494(25-32)Online publication date: 21-Nov-2011
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media