Meetha Nesam James
Nimesha Ranasinghe
Anthony Tang
ABSTRACT
People are typically involved in different activities while eating, particularly when eating alone, such as watching television or playing games on their phones. Previous research in Human-Food Interaction (HFI) has primarily focused on studying people’s motivation and analyzing of the media content watched while eating. However, their impact on human behavioral and cognitive processes, particularly flavor perception and its attributes, remains underexplored. We present a user study to investigate the influence of six types of videos, including mukbang – a new food video genre, on flavor perceptions (taste sensations, liking, and emotions) while eating plain white rice. Our findings revealed that participants perceived positive emotional changes and reported significant differences in their augmented taste sensations (e.g., spicy and salty) with different food-based videos. Our findings provided insights into using our approach to promote digital commensality and healthier eating (digital augmentation without altering the food), highlighting the scope for future research.
- Mahmoud A Alamir and Kristy Hansen. 2021. The effect of type and level of background noise on food liking: A laboratory non-focused listening test. Applied Acoustics 172(2021), 107600.Google Scholar
Cross Ref
- Ferran Altarriba Bertran, Samvid Jhaveri, Rosa Lutz, Katherine Isbister, and Danielle Wilde. 2019. Making Sense of Human-Food Interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300908Google ScholarDigital Library
- John Anderer. 2019. ‘Zombie Eating’: 88% Of Adults Dine While Staring At A Screen, Survey Finds. https://www.studyfinds.org/zombie-eating-88-percent-adults-dine-while-staring-at-screen-survey-finds/Google Scholar
- Tjark Andersen, Derek Victor Byrne, and Qian Janice Wang. 2021. How Digital Food Affects Our Analog Lives: The Impact of Food Photography on Healthy Eating Behavior. Frontiers in Psychology 12 (2021), 980.Google ScholarCross Ref
- Laurensia Anjani, Terrance Mok, Anthony Tang, Lora Oehlberg, and Wooi Boon Goh. 2020. Why Do People Watch Others Eat Food? An Empirical Study on the Motivations and Practices of Mukbang Viewers. Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376567Google ScholarDigital Library
- Julia Aucoin. 2019. Virtual Commensality: Mukbang and Food Television. Ph.D. Dissertation. McGill University,Canada. https://library.umaine.edu/auth/EZproxy/test/authej.asp?url=https://search.proquest.com/dissertations-theses/virtual-commensality-mukbang-food-television/docview/2507072518/se-2?accountid=14583 Copyright – Database copyright ProQuest LLC; ProQuest does not claim copyright in the individual underlying works; Last updated – 2021-10-20.Google Scholar
- Malika Auvray and Charles Spence. 2008. The multisensory perception of flavor. Consciousness and cognition 17, 3 (2008), 1016–1031.Google Scholar
- Ajay Bailey. 2017. The migrant suitcase: Food, belonging and commensality among Indian migrants in The Netherlands. Appetite 110(2017), 51–60.Google ScholarCross Ref
- Shoshana Blum-Kulka. 1993. “You gotta know how to tell a story”: Telling, tales, and tellers in American and Israeli narrative events at dinner. Language in Society 22, 3 (1993), 361–402.Google ScholarCross Ref
- Isabelle Boutrolle, Julien Delarue, Delphine Arranz, Michel Rogeaux, and Egon Peter Köster. 2007. Central location test vs. home use test: Contrasting results depending on product type. Food Quality and Preference 18, 3 (2007), 490–499.Google ScholarCross Ref
- Eleonora Ceccaldi, Gijs Huisman, Gualtiero Volpe, and Maurizio Mancini. 2020. Guess Who’s Coming to Dinner? Surveying Digital Commensality During Covid-19 Outbreak. In Companion Publication of the 2020 International Conference on Multimodal Interaction (Virtual Event, Netherlands) (ICMI ’20 Companion). Association for Computing Machinery, New York, NY, USA, 317–321. https://doi.org/10.1145/3395035.3425649Google ScholarDigital Library
- Elaine T Champagne. 2008. Rice aroma and flavor: a literature review. Cereal Chemistry 85, 4 (2008), 445–454.Google ScholarCross Ref
- Hanwool Choe. 2019. Eating together multimodally: Collaborative eating in mukbang, a Korean livestream of eating. Language in Society 48, 2 (2019), 171–208.Google ScholarCross Ref
- Ashley Thuthao Keng Dam. 2009. Mukbang and the Progression Toward Digital Commensality.Google Scholar
- Peter G Enticott, Bronwyn A Harrison, Sara L Arnold, Kaitlyn Nibaldi, Rebecca A Segrave, Bernadette M Fitzgibbon, Hayley A Kennedy, Kristal Lau, and Paul B Fitzgerald. 2012. Emotional valence modulates putative mirror neuron activity. Neuroscience Letters 508, 1 (2012), 56–59.Google ScholarCross Ref
- Peter G Enticott, Patrick J Johnston, Sally E Herring, Kate E Hoy, and Paul B Fitzgerald. 2008. Mirror neuron activation is associated with facial emotion processing. Neuropsychologia 46, 11 (2008), 2851–2854.Google ScholarCross Ref
- Frederick Erickson. 1982. Money tree, lasagna bush, salt and pepper: Social construction of topical cohesion in a conversation among Italian-Americans. Analyzing discourse: Text and talk, Washington. 43–70 pages.Google Scholar
- Brian S Everitt and Anders Skrondal. 2010. The Cambridge dictionary of statistics. Cambridge University Press, United Kingdom.Google Scholar
- Pier F Ferrari and Gino Coudé. 2018. Mirror neurons, embodied emotions, and empathy. In Neuronal correlates of empathy. Elsevier, United States, 67–77.Google Scholar
- Claude Fischler. 2011. Commensality, society and culture. Social science information 50, 3-4 (2011), 528–548.Google Scholar
- Mendel Friedman. 2003. Nutritional consequences of food processing. Forum of nutrition 56(2003), 350—352.Google Scholar
- Naomi K Fukagawa and Lewis H Ziska. 2019. Rice: importance for global nutrition. Journal of nutritional science and vitaminology 65, Supplement(2019), S2–S3.Google ScholarCross Ref
- Maximo Gacula Jr and Sheri Rutenbeck. 2006. Sample size in consumer test and descriptive analysis. Journal of sensory studies 21, 2 (2006), 129–145.Google ScholarCross Ref
- Sheila Gahagan. 2012. The development of eating behavior-biology and context. Journal of developmental and behavioral pediatrics: JDBP 33, 3(2012), 261.Google ScholarCross Ref
- Tom Gayler and Corina Sas. 2017. An Exploration of Taste-Emotion Mappings from the Perspective of Food Design Practitioners. In Proceedings of the 2nd ACM SIGCHI International Workshop on Multisensory Approaches to Human-Food Interaction (Glasgow, UK) (MHFI 2017). Association for Computing Machinery, New York, NY, USA, 23–28. https://doi.org/10.1145/3141788.3141793Google ScholarDigital Library
- Walter R Gove and Michael R Geerken. 1977. Response bias in surveys of mental health: An empirical investigation. American journal of Sociology 82, 6 (1977), 1289–1317.Google ScholarCross Ref
- Catherine Grevet, Anthony Tang, and Elizabeth Mynatt. 2012. Eating Alone, Together: New Forms of Commensality. In Proceedings of the 17th ACM International Conference on Supporting Group Work (Sanibel Island, Florida, USA) (GROUP ’12). Association for Computing Machinery, New York, NY, USA, 103–106. https://doi.org/10.1145/2389176.2389192Google ScholarDigital Library
- Marion M Hetherington, Annie S Anderson, Geraldine NM Norton, and Lisa Newson. 2006. Situational effects on meal intake: A comparison of eating alone and eating with others. Physiology & behavior 88, 4-5 (2006), 498–505.Google Scholar
- Sara R Jaeger and Christelle Porcherot. 2017. Consumption context in consumer research: Methodological perspectives. Current Opinion in Food Science 15 (2017), 30–37.Google ScholarCross Ref
- Sunjoo Jang, Haeyoung Lee, and Seunghye Choi. 2021. Associations among solo dining, self-determined solitude, and depression in South Korean university students: a cross-sectional study. International journal of environmental research and public health 18, 14(2021), 7392.Google Scholar
- Martin Jones 2007. Feast: Why humans share food. Oxford University Press, United Kingdom.Google Scholar
- EunKyo Kang, Jihye Lee, Kyae Hyung Kim, and Young Ho Yun. 2020. The popularity of eating broadcast: Content analysis of “mukbang” YouTube videos, media coverage, and the health impact of “mukbang” on public. Health informatics journal 26, 3 (2020), 2237–2248.Google Scholar
- Nobuyuki Kawai, Zhuogen Guo, and Ryuzaburo Nakata. 2021. A human voice, but not human visual image makes people perceive food to taste better and to eat more:“Social” facilitation of eating in a digital media. Appetite 167(2021), 105644.Google ScholarCross Ref
- Silvia C King, Herbert L Meiselman, and B Thomas Carr. 2010. Measuring emotions associated with foods in consumer testing. Food Quality and Preference 21, 8 (2010), 1114–1116.Google ScholarCross Ref
- Kagan Kircaburun, Andrew Harris, Filipa Calado, and Mark D Griffiths. 2021. The psychology of mukbang watching: A scoping review of the academic and non-academic literature. International Journal of Mental Health and Addiction 19, 4 (2021), 1190–1213.Google ScholarCross Ref
- Harry T Lawless, Hildegarde Heymann, 2010. Sensory evaluation of food: principles and practices. Vol. 2. Springer, New York.Google Scholar
- Deborah Lupton. 2020. Understanding digital food cultures. Routledge, London.Google Scholar
- Neil Malhotra. 2008. Completion time and response order effects in web surveys. Public opinion quarterly 72, 5 (2008), 914–934.Google Scholar
- Maurizio Mancini, Radoslaw Niewiadomski, Gijs Huisman, Merijn Bruijnes, and Conor Patrick Gallagher. 2020. Room for One More? – Introducing Artificial Commensal Companions. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI EA ’20). Association for Computing Machinery, New York, NY, USA, 1–8. https://doi.org/10.1145/3334480.3383027Google ScholarDigital Library
- Herbert L. Meiselman. 2008. Experiencing food products within a physical and social context. Elsevier, San Diego, 559–580. https://doi.org/10.1016/B978-008045089-6.50027-7Google Scholar
- Harold Mouras, Serge Stoléru, Virginie Moulier, Mélanie Pélégrini-Issac, Roland Rouxel, Bernard Grandjean, Dominique Glutron, and Jacques Bittoun. 2008. Activation of mirror-neuron system by erotic video clips predicts degree of induced erection: an fMRI study. Neuroimage 42, 3 (2008), 1142–1150.Google ScholarCross Ref
- Natalie D Munro and Leore Grosman. 2010. Early evidence (ca. 12,000 BP) for feasting at a burial cave in Israel. Proceedings of the National Academy of Sciences 107, 35(2010), 15362–15366.Google ScholarCross Ref
- Takuji Narumi, Yuki Ban, Takashi Kajinami, Tomohiro Tanikawa, and Michitaka Hirose. 2012. Augmented Perception of Satiety: Controlling Food Consumption by Changing Apparent Size of Food with Augmented Reality. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI ’12). Association for Computing Machinery, New York, NY, USA, 109–118. https://doi.org/10.1145/2207676.2207693Google ScholarDigital Library
- Takuji Narumi, Shinya Nishizaka, Takashi Kajinami, Tomohiro Tanikawa, and Michitaka Hirose. 2011. Augmented Reality Flavors: Gustatory Display Based on Edible Marker and Cross-Modal Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11). Association for Computing Machinery, New York, NY, USA, 93–102. https://doi.org/10.1145/1978942.1978957Google ScholarDigital Library
- Takuji Narumi, Munehiko Sato, Tomohiro Tanikawa, and Michitaka Hirose. 2010. Evaluating Cross-Sensory Perception of Superimposing Virtual Color onto Real Drink: Toward Realization of Pseudo-Gustatory Displays. In Proceedings of the 1st Augmented Human International Conference (Megève, France) (AH ’10). Association for Computing Machinery, New York, NY, USA, Article 18, 6 pages. https://doi.org/10.1145/1785455.1785473Google ScholarDigital Library
- M Ng, C Chaya, and J Hort. 2013. Beyond liking: Comparing the measurement of emotional response using EsSense Profile and consumer defined check-all-that-apply methodologies. Food Quality and Preference 28, 1 (2013), 193–205.Google ScholarCross Ref
- Marianna Obrist, Rob Comber, Sriram Subramanian, Betina Piqueras-Fiszman, Carlos Velasco, and Charles Spence. 2014. Temporal, Affective, and Embodied Characteristics of Taste Experiences: A Framework for Design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). Association for Computing Machinery, New York, NY, USA, 2853–2862. https://doi.org/10.1145/2556288.2557007Google ScholarDigital Library
- Marianna Obrist, Carlos Velasco, Chi Vi, Nimesha Ranasinghe, Ali Israr, Adrian Cheok, Charles Spence, and Ponnampalam Gopalakrishnakone. 2016. Sensing the future of HCI: touch, taste, and smell user interfaces. interactions 23, 5 (2016), 40–49.Google ScholarDigital Library
- Marianna Obrist, Carlos Velasco, Chi Thanh Vi, Nimesha Ranasinghe, Ali Israr, Adrian D. Cheok, Charles Spence, and Ponnampalam Gopalakrishnakone. 2016. Touch, Taste, & Smell User Interfaces: The Future of Multisensory HCI. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems(San Jose, California, USA) (CHI EA ’16). Association for Computing Machinery, New York, NY, USA, 3285–3292. https://doi.org/10.1145/2851581.2856462Google ScholarDigital Library
- Ethan Pancer, Matthew Philp, Maxwell Poole, and Theodore J Noseworthy. 2021. Content Hungry: How the Nutrition of Food Media Influences Social Media Engagement. Journal of Consumer Psychology 32, 2 (2021), 336–349.Google ScholarCross Ref
- Beulah Pereira, Billy Sung, and Sean Lee. 2019. I like watching other people eat: A cross-cultural analysis of the antecedents of attitudes towards Mukbang. Australasian marketing journal 27, 2 (2019), 78–90.Google Scholar
- Patricia. Pliner and Rick. Bell. 2009. A table for one: the pain and pleasure of eating alone. Woodhead Publishing, Cambridge, 169–189. https://doi.org/10.1533/9781845695712.4.169Google Scholar
- Nimesha Ranasinghe, Adrian Cheok, Ryohei Nakatsu, and Ellen Yi-Luen Do. 2013. Simulating the Sensation of Taste for Immersive Experiences. In Proceedings of the 2013 ACM International Workshop on Immersive Media Experiences (Barcelona, Spain) (ImmersiveMe ’13). Association for Computing Machinery, New York, NY, USA, 29–34. https://doi.org/10.1145/2512142.2512148Google ScholarDigital Library
- Nimesha Ranasinghe, Meetha Nesam James, Michael Gecawicz, Jonathan Bland, and David Smith. 2020. Influence of Electric Taste, Smell, Color, and Thermal Sensory Modalities on the Liking and Mediated Emotions of Virtual Flavor Perception. Association for Computing Machinery, New York, NY, USA, 296–304. https://doi-org.wv-o-ursus-proxy02.ursus.maine.edu/10.1145/3382507.3418862Google Scholar
- Nimesha Ranasinghe, Kasun Karunanayaka, Adrian David Cheok, Owen Noel Newton Fernando, Hideaki Nii, and Ponnampalam Gopalakrishnakone. 2011. Digital Taste and Smell Communication. In Proceedings of the 6th International Conference on Body Area Networks (Beijing, China) (BodyNets ’11). ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), Brussels, BEL, 78–84.Google ScholarDigital Library
- Nimesha Ranasinghe, Kuan-Yi Lee, Gajan Suthokumar, and Ellen Yi-Luen Do. 2014. Taste+: Digitally Enhancing Taste Sensations of Food and Beverages. In Proceedings of the 22nd ACM International Conference on Multimedia (Orlando, Florida, USA) (MM ’14). Association for Computing Machinery, New York, NY, USA, 737–738. https://doi.org/10.1145/2647868.2654878Google ScholarDigital Library
- Nimesha Ranasinghe, Thi Ngoc Tram Nguyen, Yan Liangkun, Lien-Ya Lin, David Tolley, and Ellen Yi-Luen Do. 2017. Vocktail: A Virtual Cocktail for Pairing Digital Taste, Smell, and Color Sensations. In Proceedings of the 25th ACM International Conference on Multimedia (Mountain View, California, USA) (MM ’17). Association for Computing Machinery, New York, NY, USA, 1139–1147. https://doi.org/10.1145/3123266.3123440Google ScholarDigital Library
- Shilpa S Samant and Han-Seok Seo. 2019. Personality traits affect the influences of intensity perception and emotional responses on hedonic rating and preference rank toward basic taste solutions. Journal of neuroscience research 97, 3 (2019), 276–291.Google ScholarCross Ref
- Jeffery Sobal and Mary K Nelson. 2003. Commensal eating patterns: a community study. Appetite 41, 2 (2003), 181–190.Google ScholarCross Ref
- Charles Spence. 2020. Multisensory flavour perception: Blending, mixing, fusion, and pairing within and between the senses. Foods 9, 4 (2020), 407.Google ScholarCross Ref
- Charles Spence, Carmel A Levitan, Maya U Shankar, and Massimiliano Zampini. 2010. Does food color influence taste and flavor perception in humans?Chemosensory Perception 3, 1 (2010), 68–84.Google Scholar
- Charles Spence, Maurizio Mancini, and Gijs Huisman. 2019. Digital commensality: Eating and drinking in the company of technology. Frontiers in psychology 10 (2019), 2252.Google Scholar
- Charles Spence, Xiaoang Wan, Andy Woods, Carlos Velasco, Jialin Deng, Jozef Youssef, and Ophelia Deroy. 2015. On tasty colours and colourful tastes? Assessing, explaining, and utilizing crossmodal correspondences between colours and basic tastes. Flavour 4, 1 (2015), 1–17.Google ScholarCross Ref
- Nanette Stroebele and John M De Castro. 2004. Effect of ambience on food intake and food choice. Nutrition 20, 9 (2004), 821–838.Google ScholarCross Ref
- Wakako Takeda, Melissa K Melby, and Yuta Ishikawa. 2018. Who eats with family and how often? Household members and work styles influence frequency of family meals in urban Japan. Appetite 125(2018), 160–171.Google ScholarCross Ref
- Aner Tal, Scott Zuckerman, and Brian Wansink. 2014. Watch what you eat: action-related television content increases food intake. JAMA Internal Medicine 174, 11 (2014), 1842–1843.Google ScholarCross Ref
- Deborah Tannen 2005. Conversational style: Analyzing talk among friends. Oxford University Press, United Kingdom.Google Scholar
- Carlos Velasco, Felipe Reinoso Carvalho, Olivia Petit, and Anton Nijholt. 2016. A Multisensory Approach for the Design of Food and Drink Enhancing Sonic Systems. In Proceedings of the 1st Workshop on Multi-Sensorial Approaches to Human-Food Interaction(Tokyo, Japan) (MHFI ’16). Association for Computing Machinery, New York, NY, USA, Article 7, 7 pages. https://doi.org/10.1145/3007577.3007578Google ScholarDigital Library
- Carlos Velasco and Marianna Obrist. 2020. Multisensory Experiences: Where the senses meet technology. Oxford University Press, United Kingdom.Google ScholarCross Ref
- Carlos Velasco, Marianna Obrist, Gijs Huisman, Anton Nijholt, Charles Spence, Kosuke Motoki, and Takuji Narumi. 2021. Perspectives on Multisensory Human-Food Interaction. Frontiers in Computer Science 3 (2021), 132.Google Scholar
- Qian Janice Wang, Steve Keller, and Charles Spence. 2017. Sounds spicy: Enhancing the evaluation of piquancy by means of a customised crossmodally congruent soundtrack. Food quality and preference 58 (2017), 1–9.Google Scholar
- Qian Janice Wang, Rachel Meyer, Stuart Waters, and David Zendle. 2020. A dash of virtual milk: altering product color in virtual reality influences flavor perception of cold-brew coffee. Frontiers in Psychology 11 (2020), 3491.Google ScholarCross Ref
- Yan Wang, Zhuying Li, Robert Jarvis, Rohit Ashok Khot, and Florian ’Floyd’ Mueller. 2018. The Singing Carrot: Designing Playful Experiences with Food Sounds. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts (Melbourne, VIC, Australia) (CHI PLAY ’18 Extended Abstracts). Association for Computing Machinery, New York, NY, USA, 669–676. https://doi.org/10.1145/3270316.3271512Google ScholarDigital Library
- Alan Warde. 2016. The practice of eating. John Wiley & Sons, United Kingdom.Google Scholar
Recommendations
Understanding Screen-based Dining Practices through the Lens of Mindful Eating
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing SystemsOur eating practices are increasingly overshadowed by the presence of screen-based media technologies that conflict with the ideologies of mindful eating. However, little is known about whether and how screens influence our eating behaviors. To ...
Watch Your Flavors: Augmenting People’s Flavor Perceptions and Associated Emotions based on Videos Watched while Eating
CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing SystemsPeople engage in different activities while eating alone, such as watching television or scrolling through social media on their phones. However, the impacts of these visual contents on human cognitive processes, particularly related to flavor ...
Exploring the Design Space for Human-Food-Technology Interaction: An Approach from the Lens of Eating Experiences
Embedded in everyday practices, food can be a rich resource for interaction design. This article focuses on eating experiences to uncover how bodily, sensory, and socio-cultural aspects of eating can be better leveraged for the design of user experience. ...
Comments