Article

Replaying live-user interactions in the off-line evaluation of critique-based mobile recommendations

Authors:

Quang Nhat Nguyen,

Francesco RicciAuthors Info & Claims

RecSys '07: Proceedings of the 2007 ACM conference on Recommender systems

Pages 81 - 88

https://doi.org/10.1145/1297231.1297245

Published: 19 October 2007 Publication History

Abstract

Supporting conversational approaches in mobile recommender systems is challenging because of the inherent limitations of mobile devices and the dependence of produced recommendations on the context. In a previous work, we proposed a critique-based mobile recommendation approach and presented the results of a live users evaluation. Live-user evaluations are expensive and there we could not compare different system variants to check all our research hypotheses. In this paper, we present an innovative simulation methodology and its use in the comparison of different user-query representation approaches. Our simulation test procedure replays off-line, against different system variants, interactions recorded in the live-user evaluation. The results of the simulation tests show that the composite query representation, which employs both logical and similarity queries, does improve the recommendation performance over a representation using either a logical or a similarity query.

References

[1]

D. Bridge, M. Göker, L. McGinty, and B. Smyth. Case-based recommender systems. Knowl. Eng. Rev., 20(3): 315--320, 2006.

Digital Library

[2]

R. Burke. Interactive critiquing for catalog navigation in e-commerce. Artif. Intell. Rev., 18(3-4): 245--267, 2002.

Digital Library

[3]

L. Chen and P. Pu. Preference-based organization interface: Aiding user critiques in recommender systems. In Proc. 11th Int'l Conf. User Modeling, pp. 77--86, 2007.

Digital Library

[4]

Z. Jiang, W. Wang, and I. Benbasat. Multimedia-based interactive advising technology for online consumer decision support. Communications of the ACM, 48(9): 92--98, 2005.

Digital Library

[5]

C. Y. Kim, J. K. Lee, Y. H. Cho, and D. H. Kim. Viscors: A visual-content recommender for the mobile Web. IEEE Intell. Syst., 19(6): 32--39, 2004.

Digital Library

[6]

K. McCarthy, L. McGinty, B. Smyth, and J. Reilly. A live-user evaluation of incremental dynamic critiquing. In Proc. 6th Int'l Conf. Case-Based Reasoning, pp. 339--352, 2005.

Digital Library

[7]

L. McGinty and B. Smyth. Adaptive selection: An analysis of critiquing and preference-based feedback in conversational recommender systems. Int'l. J. Electronic Commerce, 11(2): 35--57, 2006.

Digital Library

[8]

Q. N. Nguyen and F. Ricci. User preferences initialization and integration in critique-based mobile recommender systems. In Proc. 5th Int'l Workshop Artif. Intell. in Mobile Syst., pp. 71--78, 2004.

[9]

P. Pu and P. Kumar. Evaluating example-based search tools. In Proc. 5th ACM Conf. Electronic Commerce, pp. 208--217, 2004.

Digital Library

[10]

P. Pu and L. Chen. Integrating tradeoff support in product search tools for e-commerce sites. In Proc. 6th ACM Conf. Electronic Commerce, pp. 269--278, 2005.

Digital Library

[11]

F. Ricci and Q. N. Nguyen. Acquiring and revising preferences in a critique-based mobile recommender system. IEEE Intell. Syst., 22(3): 22--29, 2007.

Digital Library

[12]

H. Shimazu. ExpertClerk: Navigating shoppers buying process with the combination of asking and proposing. In Proc. 17th Int'l Joint Conf. Artif. Intell., pp. 1443--1450, 2001.

Digital Library

[13]

C. A. Thompson, M. H. Göker, and P. Langley. A personalized system for conversational recommendations. Artif. Intell. Research, 21: 393--428, 2004.

Digital Library

[14]

M. van Setten, S. Pokraev, and J. Koolwaaij. Context-aware recommendations in the mobile tourist application COMPASS. In Proc. 3rd Int'l Conf. Adaptive Hypermedia and Adaptive Web-Based Syst., pp. 235--244, 2004.

[15]

Z. Yu, X. Zhou, D. Zhang, C.-Y. Chin, X. Wang, and J. Men. Supporting context-aware media recommendations for smart phones. IEEE Pervasive Comp., 5(3): 68--75, 2006.

Digital Library

[16]

B. Zhou, S. C. Hui, and K. Chang. Enhancing mobile Web access using intelligent recommendations. IEEE Intell. Syst., 21(1): 28--34, 2006.

Digital Library

Cited By

Sànchez-Marrè MSànchez-Marrè M(2022)Advanced IDSS Topics and ApplicationsIntelligent Decision Support Systems10.1007/978-3-030-87790-3_9(583-766)Online publication date: 29-Mar-2022
https://doi.org/10.1007/978-3-030-87790-3_9
Jugovac MJannach D(2017)Interacting with Recommenders—Overview and Research DirectionsACM Transactions on Interactive Intelligent Systems10.1145/30018377:3(1-46)Online publication date: 19-Sep-2017
https://dl.acm.org/doi/10.1145/3001837
Trabelsi WWilson NBridge DRicci F(2010)Comparing Approaches to Preference Dominance for Conversational RecommendersProceedings of the 2010 22nd IEEE International Conference on Tools with Artificial Intelligence - Volume 0210.1109/ICTAI.2010.91(113-120)Online publication date: 27-Oct-2010
https://dl.acm.org/doi/10.1109/ICTAI.2010.91
Show More Cited By

Index Terms

Replaying live-user interactions in the off-line evaluation of critique-based mobile recommendations
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
    2. Interaction paradigms
      1. Graphical user interfaces

Recommendations

Acquiring and Revising Preferences in a Critique-Based Mobile Recommender System

Personalized product recommendations, generated by e-commerce recommender systems, can provide helpful information and decision support when users are overwhelmed by product alternatives. Although many successful Web-based recommender systems have been ...
Long-term and session-specific user preferences in a mobile recommender system
IUI '08: Proceedings of the 13th international conference on Intelligent user interfaces

User preferences acquisition plays a very important role for recommender systems. In a previous paper, we proposed a critique-based mobile recommendation methodology exploiting both long-term and session-specific user preferences. In this paper, we ...
The effectiveness of user-centric social interfaces on evaluating mobile recommendations
ICEC '16: Proceedings of the 18th Annual International Conference on Electronic Commerce: e-Commerce in Smart connected World

Many studies on recommender systems have focused on increasing their accuracy by enhancing the algorithms employed. Social perceptions, however, influence both satisfaction and perceived accuracy of mobile recommender systems. Thus, the aim of this ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

RecSys '07: Proceedings of the 2007 ACM conference on Recommender systems

October 2007

222 pages

ISBN:9781595937308

DOI:10.1145/1297231

General Chair:
Joseph A. Konstan
University of Minnesota, USA
,
Program Chairs:
John Riedl
University of Minnesota, USA
,
Barry Smyth
University College, Dublin, Ireland

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 October 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

RecSys07

Sponsor:

RecSys07: ACM Conference on Recommender Systems

October 19 - 20, 2007

MN, Minneapolis, USA

Acceptance Rates

Overall Acceptance Rate 254 of 1,295 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
574
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Sànchez-Marrè MSànchez-Marrè M(2022)Advanced IDSS Topics and ApplicationsIntelligent Decision Support Systems10.1007/978-3-030-87790-3_9(583-766)Online publication date: 29-Mar-2022
https://doi.org/10.1007/978-3-030-87790-3_9
Jugovac MJannach D(2017)Interacting with Recommenders—Overview and Research DirectionsACM Transactions on Interactive Intelligent Systems10.1145/30018377:3(1-46)Online publication date: 19-Sep-2017
https://dl.acm.org/doi/10.1145/3001837
Trabelsi WWilson NBridge DRicci F(2010)Comparing Approaches to Preference Dominance for Conversational RecommendersProceedings of the 2010 22nd IEEE International Conference on Tools with Artificial Intelligence - Volume 0210.1109/ICTAI.2010.91(113-120)Online publication date: 27-Oct-2010
https://dl.acm.org/doi/10.1109/ICTAI.2010.91
McGinty LReilly J(2010)On the Evolution of Critiquing RecommendersRecommender Systems Handbook10.1007/978-0-387-85820-3_13(419-453)Online publication date: 5-Oct-2010
https://doi.org/10.1007/978-0-387-85820-3_13
Ricci FRokach LShapira B(2010)Introduction to Recommender Systems HandbookRecommender Systems Handbook10.1007/978-0-387-85820-3_1(1-35)Online publication date: 5-Oct-2010
https://doi.org/10.1007/978-0-387-85820-3_1
Nguyen QRicci FStaab S(2008)Long-term and session-specific user preferences in a mobile recommender systemProceedings of the 13th international conference on Intelligent user interfaces10.1145/1378773.1378835(381-384)Online publication date: 13-Jan-2008
https://dl.acm.org/doi/10.1145/1378773.1378835
Averjanova ORicci FNguyen Q(2008)Map-Based Interaction with a Conversational Mobile Recommender SystemProceedings of the 2008 The Second International Conference on Mobile Ubiquitous Computing, Systems, Services and Technologies10.1109/UBICOMM.2008.16(212-218)Online publication date: 29-Sep-2008
https://dl.acm.org/doi/10.1109/UBICOMM.2008.16
Nguyen QRicci F(2008)Conversational Case-Based Recommendations Exploiting a Structured Case ModelProceedings of the 9th European conference on Advances in Case-Based Reasoning10.1007/978-3-540-85502-6_27(400-414)Online publication date: 1-Sep-2008
https://dl.acm.org/doi/10.1007/978-3-540-85502-6_27

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten