skip to main content
10.1145/2756406.2756913acmconferencesArticle/Chapter ViewAbstractPublication PagesjcdlConference Proceedingsconference-collections
research-article

What does Twitter Measure?: Influence of Diverse User Groups in Altmetrics

Published: 21 June 2015 Publication History

Abstract

The most important goal for digital libraries is to ensure high quality search experience for all kinds of users. To attain this goal, it is necessary to have as much relevant metadata as possible at hand to assess the quality of publications. Recently, a new group of metrics appeared, that has the potential to raise the quality of publication metadata to the next level -- the altmetrics. These metrics try to reflect the impact of publications within the social web. However, currently it is still unclear if and how altmetrics should be used to assess the quality of a publication and how altmetrics are related to classical bibliographical metrics (like e.g. citations). To gain more insights about what kind of concepts are reflected by altmetrics, we conducted an in-depth analysis on a real world dataset crawled from the Public Library of Science (PLOS). Especially, we analyzed if the common approach to regard the users in the social web as one homogeneous group is sensible or if users need to be divided into diverse groups in order to receive meaningful results.

References

[1]
A. Pritchard, Statistical Bibliography or Bibliometrics, Journal of Documentation, vol. 25, pp. 348--349, 1969
[2]
E. Garfield, The Thomson Reuters Impact Institute, Technical Report, Factor for Scientific Information, 1994
[3]
J. E. Hirsch, An index to quantify an individual's scientific research output, Proc. Natl. Acad. Sci. U. S. A., vol. 102, pp. 16569--16572, 2005
[4]
T. Brody and S. Harnad, Earlier Web Usage Statistics as Predictors of Later Citation Impact, Journal of the American Society for Information Science and Technology, vol. 57, no. 8, pp. 1060--1072, 2006
[5]
J. Priem, K. Costello and T. Dzuba, Prevalence and use of Twitter among scholars, figshare. 2012
[6]
J. Priem and K. L. Costello, How and why scholars cite on Twitter, Proc. Am. Soc. Inf. Sci. Technol., vol. 47, no. 1, pp. 1--4, 2010
[7]
J. Bar-Ilan, S. Haustein, I. Peters, J. Priem, H. Shema, and J. Terliesner, Beyond citations: Scholars' visibility on the social web, in Proceedings of 17th International Conference on Science and Technology Indicators, vol. 52900, pp. 98--109, 2012
[8]
J. Priem and B. M. Hemminger, Scientometrics 2.0: Toward new metrics of scholarly impact on the social Web, First Monday, vol. 15, no. 7, 2010
[9]
C. Neylon and S. Wu, Article-level metrics and the evolution of scientific impact, PLoS Biol'09, vol. 7, no. 11, 2009
[10]
D. Taraborelli, Soft peer review: Social Software and Distributed Scientific Evaluation, in International Conference on the Design of Cooperative Systems, 2008
[11]
M. Fenner, What can article-level metrics do for you?, PLoS Biol., vol. 11, no. 10, p. e1001687, 2013
[12]
P. Groth and T. Gurney, Studying Scientific Discourse on the Web using Bibliometrics: A Chemistry Blogging Case Study, WebSci'10, 2010
[13]
M. Thelwall, S. Haustein, V. Lariviére, and C. R. Sugimoto, Do altmetrics work? Twitter and ten other social web services, PLoS One, vol. 8, no. 5, 2013
[14]
R. C. Roemer and R. Borchardt, Institutional Altmetrics and Academic Libraries, Inf. Stand. Q., vol. 25, no. 2, pp. 14--19, 2013
[15]
J. Liu and E. Adie, Five challenges in altmetrics: A toolmaker's perspective, Bull. Am. Soc. Inf. Sci. Technol., vol. 39, pp. 31--34, 2013
[16]
P. Wouters and R. Costas, Users' narcissism and control -- tracking the impact of scholarly publications in the 21 st century, Image Rochester NY, p. 50 pages, 2012
[17]
H. A. Piwowar, Altmetrics: Value all research products, Nature, vol. 493, p. 159, 2013
[18]
X. Li, M. Thelwall, and D. Giustini, Validating online reference managers for scholarly impact measurement, Scientometrics, vol. 91. pp. 461--471, 2012
[19]
E. S. Darling, D. Shiffman, I. M. Côté, and J. a. Drew, The role of Twitter in the life cycle of a scientific publication, PeerJ Prepr., vol. 1, p. 16, 2013
[20]
K. Weller, E. Dröge, and C. Puschmann, Citation Analysis in Twitter: Approaches for Defining and Measuring Information Flows within Tweets during Scientific Conferences, Proc. ESWC'11, pp. 1--12, 2011
[21]
C. R. Sugimoto and M. Thelwall, Scholars on Soap Boxes: Science Communication and Dissemination via TED Videos, J. Am. Soc. Inf. Sci. Technol., 2012
[22]
B. Cronin, Metrics á la mode, J. Am. Soc. Inf. Sci. Technol., vol. 64, no. 6, pp. 1091--1091, 2013
[23]
J. Kaur, D. T. Hoang, X. Sun, L. Possamai, M. JafariAsbagh, S. Patil, and F. Menczer, Scholarometer: A Social Framework for Analyzing Impact across Disciplines, PLoS One, vol. 7, 2012
[24]
M. Taylor, Exploring the Boundaries: How Altmetrics Can Expand Our Vision of Scholarly Communication and Social Impact, Inf. Stand. Q., vol. 25, no. 2, p. 27, 2013
[25]
K.-K. Yan and M. Gerstein, The spread of scientific information: insights from the web usage statistics in PLoS article-level metrics, PLoS One, vol. 6, no. 5, 2011
[26]
W. Gunn, Social signals reflect academic impact: What it means when a scholar adds a paper to Mendeley, Inf. Stand. Q., vol. 25, no. 2, pp. 33--39, 2013
[27]
I. Guy, U. Avraham, D. Carmel, S. Ur, M. Jacovi, and I. Ronen, Mining expertise and interests from social media, WWW'13, pp. 515--526, 2013
[28]
S. Ghosh, N. Sharma, and F. Benevenuto, Cognos: crowdsourcing search for topic experts in microblogs, SIGIR'12, no. 1, pp. 575--584, 2012
[29]
G. Eysenbach, Correction: Can Tweets Predict Citations? Metrics of Social Impact Based on Twitter and Correlation with Traditional Metrics of Scientific Impact, Journal of Medical Internet Research, 2012
[30]
X. Shuai, A. Pepe, and J. Bollen, How the Scientific Community Reacts to Newly Submitted Preprints: Article Downloads, Twitter Mentions, and Citations, PLoS One, vol. 7, 2012
[31]
R. Costas, Z. Zahedi, and P. Wouters, Do altmetrics correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective, CoRR'14, 2014
[32]
S. Haustein, I. Peters, C. R. Sugimoto, M. Thelwall, and V. Lariviére, Tweeting biomedicine: An analysis of tweets and citations in the biomedical literature, J. Assoc. Inf. Sci. Technol., 2013
[33]
K. Wickre, Celebrating#Twitter7, {Accessed: 10-Mar-2014}. https://blog.twitter.com/2013/celebrating-twitter7, 2013
[34]
D. Milne and I. H. Witten, An open-source toolkit for mining Wikipedia, Artif. Intell., vol. 194, pp. 222--239, 2013
[35]
P. Siehndel and R. Kawase, Twikime! User profiles that make sense, In Proceedings of the 11th International Semantic Web Conference (Posters and Demos), 2012

Cited By

View all
  • (2024)O debate público sobre o distanciamento social no contexto da COVID-19RDBCI: Revista Digital de Biblioteconomia e Ciência da Informação10.20396/rdbci.v23i00.867574323(e025002)Online publication date: 4-Dec-2024
  • (2023)Towards a better understanding of Facebook Altmetrics in LIS field: assessing the characteristics of involved paper, user and postScientometrics10.1007/s11192-023-04678-6128:5(3147-3170)Online publication date: 30-Mar-2023
  • (2021)Mapping the impact of papers on various status groups in excellencemapping.net: a new release of the excellence mapping tool based on citation and reader scoresScientometrics10.1007/s11192-021-04141-4126:11(9305-9331)Online publication date: 1-Nov-2021
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
JCDL '15: Proceedings of the 15th ACM/IEEE-CS Joint Conference on Digital Libraries
June 2015
324 pages
ISBN:9781450335942
DOI:10.1145/2756406
  • General Chairs:
  • Paul Logasa Bogen,
  • Suzie Allard,
  • Holly Mercer,
  • Micah Beck,
  • Program Chairs:
  • Sally Jo Cunningham,
  • Dion Goh,
  • Geneva Henry
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 June 2015

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. altmetrics
  2. correlation analysis
  3. expert mining
  4. social media
  5. twitter

Qualifiers

  • Research-article

Conference

JCDL '15
Sponsor:
JCDL '15: 15th ACM/IEEE-CS Joint Conference on Digital Libraries
June 21 - 25, 2015
Tennessee, Knoxville, USA

Acceptance Rates

JCDL '15 Paper Acceptance Rate 18 of 60 submissions, 30%;
Overall Acceptance Rate 415 of 1,482 submissions, 28%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)7
  • Downloads (Last 6 weeks)0
Reflects downloads up to 20 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)O debate público sobre o distanciamento social no contexto da COVID-19RDBCI: Revista Digital de Biblioteconomia e Ciência da Informação10.20396/rdbci.v23i00.867574323(e025002)Online publication date: 4-Dec-2024
  • (2023)Towards a better understanding of Facebook Altmetrics in LIS field: assessing the characteristics of involved paper, user and postScientometrics10.1007/s11192-023-04678-6128:5(3147-3170)Online publication date: 30-Mar-2023
  • (2021)Mapping the impact of papers on various status groups in excellencemapping.net: a new release of the excellence mapping tool based on citation and reader scoresScientometrics10.1007/s11192-021-04141-4126:11(9305-9331)Online publication date: 1-Nov-2021
  • (2019)Stepping Out of the Ivory Tower for Ocean LiteracyFrontiers in Marine Science10.3389/fmars.2019.000606Online publication date: 19-Feb-2019
  • (2019)Do altmetrics assess societal impact in a comparable way to case studies? An empirical test of the convergent validity of altmetrics based on data from the UK research excellence framework (REF)Journal of Informetrics10.1016/j.joi.2019.01.00813:1(325-340)Online publication date: Feb-2019
  • (2019)Scholarly Twitter MetricsSpringer Handbook of Science and Technology Indicators10.1007/978-3-030-02511-3_28(729-760)Online publication date: 2019
  • (2019)Who shares health and medical scholarly articles on Facebook?Learned Publishing10.1002/leap.127133:2(111-118)Online publication date: 26-Nov-2019
  • (2018)Do altmetrics correlate with the quality of papers? A large-scale empirical study based on F1000Prime dataPLOS ONE10.1371/journal.pone.019713313:5(e0197133)Online publication date: 23-May-2018
  • (2017)Scholarly use of social media and altmetricsJournal of the Association for Information Science and Technology10.1002/asi.2383368:9(2037-2062)Online publication date: 1-Sep-2017
  • (2016)To be or not to be on Twitter, and its relationship with the tweeting and citation of research papersScientometrics10.1007/s11192-016-2113-0109:2(1353-1364)Online publication date: 1-Nov-2016

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media