"Algorithms ruin everything": #RIPTwitter, Folk Theories, and Resistance to Algorithmic Change in Social Media

ABSTRACT

As algorithmically-driven content curation has become an increasingly common feature of social media platforms, user resistance to algorithmic change has become more frequent and visible. These incidents of user backlash point to larger issues such as inaccurate understandings of how algorithmic systems work as well as mismatches between designer and user intent. Using a content analysis of 102,827 tweets from #RIPTwitter, a recent hashtag-based backlash to rumors about introducing algorithmic curation to Twitter's timeline, this study addresses the nature of user resistance in the form of the complaints being expressed, folk theories of the algorithmic system espoused by users, and how these folk theories potentially frame user reactions. We find that resistance to algorithmic change largely revolves around expectation violation, with folk theories acting as frames for reactions such that more detailed folk theories are expressed through more specific reactions to algorithmic change.

References

1. Daniel Bates and Rob Waugh. 2011. Facebook blog is inundated with thousands of protests as users start Facebook group 'We Hate the New News Feed'. Retrieved from http://www.dailymail.co.uk/sciencetech/article2039726/Facebook-changes-Thousands-protests-We-hate-new-news-feed-group.html
2. Anol Bhattacherjee. 2001. Understanding Information Systems Continuance: An Expectation-Confirmation Model. MIS Quarterly, 25, 3: 351--370.
3. Engin Bozdag. 2013. Bias in algorithmic filtering and personalization. Ethics and Information Technology, 15, 3: 209--227.
4. Samuel Brody and Nicholas Diakopoulos. 2011. Cooooooooooooooollllllllllllll!!!!!!!!!!!!!!: using word lengthening to detect sentiment in microblogs. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, 562--570.
5. Taina Bucher. 2016. The algorithmic imaginary: exploring the ordinary affects of Facebook algorithms. Information, Communication & Society, 1--15.
6. Nitesh V. Chawla, Kevin W. Bowyer, Lawrence O. Hall, and W. Philip Kegelmeyer. 2002. SMOTE: Synthetic Minority Over-sampling Technique. Journal of Artificial Intelligence Research, 16, 1: 321--357.
7. Elizabeth Davidson. 2006. A technological frames perspective on information technology and organizational change. The Journal of Applied Behavioral Science, 42, 1: 23--39.
8. Fred D. Davis. 1989. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13, 3: 319--340.
9. Maeve Duggan. 2015. Mobile Messaging and Social Media 2015. Pew Research Center, Washington, DC.
10. Motahhare Eslami, Karrie Karahalios, Christian Sandvig, Kristen Vaccaro, Aimee Rickman, Kevin Hamilton, and Alex Kirlik. 2016. First I "like" it, then I hide it: Folk Theories of Social Feeds. In Proceedings of the 34rd Annual SIGCHI Conference on Human Factors in Computing Systems, 2371--2382.
11. Motahhare Eslami, Aimee Rickman, Kristen Vaccaro, Amirhossein Aleyasen, Andy Vuong, Karrie Karahalios, Kevin Hamilton, and Christian Sandvig. 2015. "I always assumed that I wasn't really that close to [her]": Reasoning about invisible algorithms in the news feed. In Proceedings of the 33rd Annual SIGCHI Conference on Human Factors in Computing Systems, 153--162.
12. Susan A. Gelman and Cristine H. Legare. 2011. Concepts and folk theories. Annual Review of Anthropology, 40, 1: 379--398.
13. Tarleton Gillespie. 2014. The Relevance of Algorithms. In Media technologies: Essays on communication, materiality, and society, Tarleton Gillespie, Pablo Boczkowski and Kirsten Foot (ed.). MIT Press, Cambridge, MA, 167--193.
14. Tarleton Gillespie. 2016. Algorithm. In Digital Keywords, Benjamin Peters (ed.). Princeton University Press, Princeton, NJ, 18--30.
15. Christopher M. Hoadley, Heng Xu, Joey J. Lee, and Mary Beth Rosson. 2010. Privacy as information access and illusory control: The case of the Facebook News Feed privacy outcry. Electronic commerce research and applications, 9, 1: 50--60.
16. Natalie Jones, Helen Ross, Timothy Lynam, Pascal Perez, and Anne Leitch. 2011. Mental Models: An Interdisciplinary Synthesis of Theory and Methods. Ecology and Society, 16, 1.
17. Yoram M. Kalman and Darren Gergle. 2014. Letter repetitions in computer-mediated communication: A unique link between spoken and online language. Computers in Human Behavior, 34, 2014: 187--193.
18. Alex Kantrowitz. 2016. Twitter To Introduce Algorithmic Timeline As Soon As Next Week. Retrieved from http://www.buzzfeed.com/alexkantrowitz/twitter-to-introduce-algorithmic-timeline-as-soon-as-next-we
19. Frank C Keil. 2010. The feasibility of folk science. Cognitive science, 34, 5: 826--862.
20. Hee-Woong Kim and Atreyi Kankanhalli. 2009. Investigating User Resistance to Information Systems Implementation: A Status Quo Bias Perspective. MIS Quarterly, 33, 3: 567--582.
21. René F. Kizilcec. 2016. How Much Information? Effects of Transparency on Trust in an Algorithmic Interface. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 2390--2395.
22. Amy Kraft. 2016. Backlash continues over Instagram's new algorithm. Retrieved from http://www.cbsnews.com/news/backlash-continues-over-instagrams-new-algorithm/
23. J. Richard Landis and Gary G. Koch. 1977. The Measurement of Observer Agreement for Categorical Data. Biometrics, 33, 1: 159--174.
24. Liette Lapointe and Suzanne Rivard. 2005. A Multilevel Model of Resistance to Information Technology Implementation. MIS Quarterly, 29, 3: 461--491.
25. Tor J. Larsen, Anne M. Sørebø, and Øystein Sørebø. 2009. The role of task-technology fit as users' motivation to continue information system use. Computers in Human Behavior, 25, 3: 778--784.
26. Brett Molina. 2016. CEO Dorsey responds to Twitter timeline outrage. Retrieved from http://www.usatoday.com/story/tech/news/2016/02/06/t witter-may-change-timelines-and-no-one-happy/79925572/
27. Wanda J. Orlikowski and Debra C. Gash. 1994. Technological frames: making sense of information technology in organizations. ACM Transactions on Information Systems (TOIS), 12, 2: 174--207.
28. Stephen J. Payne. 2003. Users' mental models: The very ideas. In HCI Models, Theories, and Frameworks: Toward a Multidisciplinary Science, John M. Carroll (ed.). Morgan Kaufmann, Burlington, MA, 135--156.
29. Emilee Rader and Rebecca Gray. 2015. Understanding User Beliefs About Algorithmic Curation in the Facebook News Feed. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, 173--182.
30. H. Andrew Schwartz and Lyle H. Ungar. 2015. DataDriven Content Analysis of Social Media A Systematic Overview of Automated Methods. The ANNALS of the American Academy of Political and Social Science, 659, 1: 78--94.
31. James Y. L. Thong, Se-Joon Hong, and Kar Yan Tam. 2006. The effects of post-adoption beliefs on the expectation-confirmation model for information technology continuance. International Journal of Human-Computer Studies, 64, 9: 799--810.
32. Robert Philip Weber. 1990. Basic Content Analysis. Sage, Thousand Oaks, CA.
33. Robert K. Yin. 2003. Case Study Research: Design and Methods. Sage Publications, Thousand Oaks, CA.
34. Yan Zhang and Barbara M. Wildemuth. 2009. Qualitative analysis of content. In Applications of Social Research Methods to Questions in Information and Library Science, Barbara M. Wildemuth (ed.). Libraries Unlimited., Westport, CT, 308--319.

Index Terms

• Human-centered computing