David A. Robb
Stefano Padilla
Thomas S. Methven
ABSTRACT
Imagery and language are often seen as serving different aspects of cognition, with cognitive styles theories proposing that people can be visual or verbal thinkers. Most feedback systems, however, only cater to verbal thinkers. To help rectify this, we have developed a novel method of crowd communication which appeals to those more visual people. Designers can ask a crowd to feedback on their designs using specially constructed image banks to discover the perceptual and emotional theme perceived by possible future customers. A major component of the method is a summarization process in which the crowd's feedback, consisting of a mass of images, is presented to the designer as a digest of representative images. In this paper we describe an experiment showing that these image summaries are as effective as the full image selections at communicating terms. This means that designers can consume the new feedback confident that it represents a fair representation of the total image feedback from the crowd.
Supplemental Material
- Chris Andrzejczak & Dahai Liu. (2010). The effect of testing location on usability testing performance, participant stress levels, and subjective testing experience. Journal of Systems and Software, 83(7), 1258--1266 Google Scholar
Digital Library
- Colin F. Camerer, & Robin M. Hogarth. (1999). The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework. Journal of Risk and Uncertainty, 19(1--3), 7--42Google ScholarCross Ref
- Daniel Chandler. 2002. Semiotics : the basics (2nd ed.), Routledge.Google Scholar
- Alasdair D.F. Clarke, Fraser Halley, Andrew J. Newell, Lewis D. Griffin, & Mike J. Chantler. 2011. Perceptual similarity: a texture challenge. In Proceedings of the 22nd British Machine Vision Conference (BMVC'11), 120.Google ScholarCross Ref
- Trevor F. Cox, & Michael A. A. Cox. 2001. Multidimensional Scaling (Second Edition ed.). Chapman & Hall/CRC.Google ScholarCross Ref
- Jonathan Culler. 1976. Saussure. Fontana.Google Scholar
- Elise S. Dan-Glauser & Klaus R. Scherer. 2011. The 8 Geneva affective picture database (GAPED): a new 730-picture database focusing on valence and normative significance. Behavior Research Methods, 43(2), 468--477.Google ScholarCross Ref
- Dribbble 2015. https://dribbble.com/ (Last accessed January 10/2015)Google Scholar
- Claudia Eckert & Martin Stacey. 2000. Sources of inspiration: a language of design. Design Studies, 21(5), 523--538.Google ScholarCross Ref
- Brian Everitt 1974. Cluster Analysis. Heinemann.Google Scholar
- Andy Field 2009. Discovering Statistics Using SPSS (3rd ed.) Sage.Google Scholar
- Steve Garner & Deana McDonagh-Philp. 2001. Problem interpretation and resolution via visual stimuli: the use of "mood boards" in design education. Journal of Art & Design Education, 20(1), 57--64.Google ScholarCross Ref
- Pierre Guiraud. 1971. Semiology, Routledge.Google Scholar
- Joeri Hofmans and Peter Theuns. 2008. On the linearity of predefined and self-anchoring Visual Analogue Scales. British Journal of Mathematical and Statistical Psychology, 61(Pt 2).Google Scholar
- Roman Jakobson. 1960. Closing statement: Linguistics and poetics. Style in language, 350, 377.Google Scholar
- Teuvo Kohonen. 1990. The self-organizing map. Proceedings of the Institute of Electrical and Electronics Engineers, 78(9), 1464--1480.Google ScholarCross Ref
- Gunther R Kress, & Theo Van Leeuwen. 1996. Reading images: The grammar of visual design, Psychology Press.Google Scholar
- Joseph B. Kruskal 1964. Nonmetric multidimensional scaling: A numerical method. Psychometrika, 29(2), 115--129.Google ScholarCross Ref
- Peter J. Lang, Margaret M. Bradley, & Bruce N. Cuthbert. 2008. International affective picture system (IAPS): Affective ratings of pictures and instruction manual. Technical Report A-8.University of Florida.Google Scholar
- Lerner, J.S., Small, D.A. and Loewenstein, G. 2004. Research Report Heart Strings and Purse Strings Carryover Effects of Emotions on Economic Decisions. Psychological Science, 15(5), APS, 337--341Google Scholar
- David McCandless. (2009). Information is beautiful. Collins.Google Scholar
- Albert Mehrabian & Susan R. Ferris. 1967. Inference of attitudes from nonverbal communication in two channels. Journal of consulting psychology, 31(3), 248.Google ScholarCross Ref
- Albert Mehrabian & Morton Wiener. 1967. Decoding of inconsistent communications. Journal of personality and social psychology, 6(1), 10.Google ScholarCross Ref
- Thomas S. Methven, Pawel M. Orzechowski, Mike J. Chantler, Sharon Baurley & Douglas Atkinson. 2011. Comparison of Crowd-Sourcing vs. Traditional Techniques for Deriving Consumer Terms. In Digital Engagement '11, http://de2011.computing.dundee.ac.uk/?page_id=211 (last accessed September 24th 2015).Google Scholar
- Mitsuo Nagamachi. 1995. Kansei engineering: a new ergonomic consumer-oriented technology for product development, International Journal of Industrial Ergonomics 15(1), 3--11.Google ScholarCross Ref
- Stefano Padilla, Fraser Halley, David A. Robb, and Mike J. Chantler. 2013. Intuitive Large Image Database Browsing using Perceptual Similarity Enriched by Crowds. In Proceedings of the 15th International Conference on Computer Analysis of Images and Patterns (CAIP'13), Springer, 169--176.Google Scholar
- Stefano Padilla, David A. Robb, Fraser Halley, & Mike J. Chantler. 2012. Browsing Abstract Art by Appearance. In Proceedings of the 3rd International Conference on Appearance: Predicting Perceptions, Lulu Press, 100--103.Google Scholar
- Sathish Pammi & Marc Schröder. 2009. Annotating meaning of listener vocalizations for speech synthesis. In Proceedings of 3rd IEEE International Conference on Affective Computing and Intelligent Interaction (ACII'09), 1--6.Google ScholarCross Ref
- Mick J. Power. 2006. The structure of emotion: An empirical comparison of six models. Cognition & Emotion, 20(5), 694--713Google ScholarCross Ref
- Ulf-Dietrich Reips and Frederik Funke. 2008. Intervallevel measurement with visual analogue scales in Internet-based research: VAS Generator. Behavior Research Methods, 40(3), 699--704.Google ScholarCross Ref
- David A. Robb, Stefano Padilla, Britta Kalkreuter, and Mike J. Chantler. 2015. Moodsource: Enabling Perceptual and Emotional Feedback from Crowds. In Proceedings of the ACM Conference Companion on Computer Supported Cooperative Work & Social Computing (CSCW'15), 21--24. Google ScholarDigital Library
- David A. Robb, Stefano Padilla, Britta Kalkreuter, and Mike J. Chantler. 2015. Crowdsourced Feedback With Imagery Rather Than Text: Would Designers Use It? In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI'15), 1355--1364. Google ScholarDigital Library
- Mark A. Runco. 2014. Creativity: Theories and themes: Research, development, and practice, Elsevier.Google Scholar
- Vera Sacharin, Katja Schlegel and K. R. Scherer. 2012. Geneva Emotion Wheel rating study (Report). University of Geneva, Swiss Center for Affective Sciences.Google Scholar
- Klaus R. Scherer. 2005. What are emotions? And how can they be measured? Social Science Information, 44(4), 695--729.Google ScholarCross Ref
- Norbert Schwarz, Herbert Bless, & Gerd Bohner. 1991. Mood and persuasion: Affective states influence the processing of persuasive communications. Advances in experimental social psychology, 24, 161--199.Google Scholar
- Ingo Siegert, Böck Bock, Bogdan Vlasenko, David Philippou-Hubner & Andreas Wendemuth. 2011. Appropriate emotional labelling of non-acted speech using basic emotions, Geneva emotion wheel and selfassessment manikins. In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME'11), 1--6. Google ScholarDigital Library
- Joan G Snodgrass, & Mary Vanderwart. 1980. A standardized set of 260 pictures: norms for name agreement, image agreement, familiarity, and visual complexity. Journal of experimental psychology: Human learning and memory, 6(2), 174.Google ScholarCross Ref
- Mohammad Soleymani & Maja Pantic 2012. Humancentered implicit tagging: Overview and perspectives. In Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics (SMC'12), 3304--3309.Google Scholar
- Andrew R H Swan & Michael Sandilands. 1995. Introduction to geological data analysis, Blackwell. 174--177.Google Scholar
- Larissa Z. Tiedens and Susan Linton. 2001. Judgment under emotional certainty and uncertainty: the effects of specific emotions on information processing. Journal of personality and social psychology, 81(6), APA, 973.Google ScholarCross Ref
- Tom Tullis, Stan Fleischman, Michelle McNulty, Carrie Cianchette & Margaret Bergel. 2002. An empirical comparison of lab and remote usability testing of web sites.Google Scholar
- Johan H. J. Vesanto, Esa Alhoniemi and Juha Parhankangas. 1999. Self-organizing map in Matlab: The SOM Toolbox. In Procedings of the Matlab DSP Conference. 35--40.Google Scholar
Index Terms
- A Picture Paints a Thousand Words but Can it Paint Just One?
Recommendations
Image-based Emotion Feedback: How Does the Crowd Feel? And Why?
DIS '17: Proceedings of the 2017 Conference on Designing Interactive SystemsIn previous work we developed a method for interior designers to receive image-based feedback about a crowd's emotions when viewing their designs. Although the designers clearly desired a service which provided the new style of feedback, we wanted to ...
Moodsource: Enabling Perceptual and Emotional Feedback from Crowds
CSCW'15 Companion: Proceedings of the 18th ACM Conference Companion on Computer Supported Cooperative Work & Social ComputingThe emotional reaction of an audience to a design can be difficult to assess but valuable to know. Moodsource allows intuitive visual communication between crowds and designers. A crowd responds to a design with selections from image banks. Visual ...
Understanding Worker Moods and Reactions to Rejection in Crowdsourcing
HT '19: Proceedings of the 30th ACM Conference on Hypertext and Social MediaRequesters on crowdsourcing platforms typically exercise the power to decide the fate of tasks completed by crowd workers. Rejecting work has a direct impact on workers; (i) they may not be rewarded for the work completed and for their effort that has ...
Comments