skip to main content
10.1145/2348283.2348325acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
research-article

An exploration of ranking heuristics in mobile local search

Published: 12 August 2012 Publication History

Abstract

Users increasingly rely on their mobile devices to search local entities, typically businesses, while on the go. Even though recent work has recognized that the ranking signals in mobile local search (e.g., distance and customer rating score of a business) are quite different from general Web search, they have mostly treated these signals as a black-box to extract very basic features (e.g., raw distance values and rating scores) without going inside the signals to understand how exactly they affect the relevance of a business. However, as it has been demonstrated in the development of general information retrieval models, it is critical to explore the underlying behaviors/heuristics of a ranking signal to design more effective ranking features.
In this paper, we follow a data-driven methodology to study the behavior of these ranking signals in mobile local search using a large-scale query log. Our analysis reveals interesting heuristics that can be used to guide the exploitation of different signals. For example, users often take the mean value of a signal (e.g., rating) from the business result list as a "pivot" score, and tend to demonstrate different click behaviors on businesses with lower and higher signal values than the pivot; the clickrate of a business generally is sublinearly decreasing with its distance to the user, etc. Inspired by the understanding of these heuristics, we further propose different transformation methods to generate more effective ranking features. We quantify the improvement of the proposed new features using real mobile local search logs over a period of 14 months and show that the mean average precision can be improved by over 7%.

References

[1]
A. Amin, S. Townsend, J. Ossenbruggen, and L. Hardman. Fancy a drink in canary wharf?: A user study on location-based mobile search. In INTERACT '09, pages 736--749, 2009.
[2]
L. Backstrom, J. Kleinberg, R. Kumar, and J. Novak. Spatial variation in search engine queries. In WWW '08, pages 357--366, 2008.
[3]
K. Berberich, A. C. König, D. Lymberopoulos, and P. Zhao. Improving local search ranking through external logs. In SIGIR '11, pages 785--794, 2011.
[4]
D. M. Blei, A. Y. Ng, and M. I. Jordan. Latent dirichlet allocation. J. Mach. Learn. Res., 3:993--1022, 2003.
[5]
Box, G. E. P. and Cox, D. R. An analysis of transformations. Journal of the Royal Statistical Society. Series B (Methodological), 26(2):211--252, 1964.
[6]
O. Chapelle and Y. Chang. Yahoo! learning to rank challenge overview. Journal of Machine Learning Research - Proceedings Track, 14:1--24, 2011.
[7]
Y.-Y. Chen, T. Suel, and A. Markowetz. Efficient query processing in geographic web search engines. In SIGMOD '06, pages 277--288, 2006.
[8]
K. Church and N. Oliver. Understanding mobile web and mobile search use in today's dynamic mobile landscape. In MobileHCI '11, pages 67--76, 2011.
[9]
K. Church, B. Smyth, P. Cotter, and K. Bradley. Mobile information access: A study of emerging search behavior on the mobile internet. ACM Trans. Web, 1, May 2007.
[10]
G. Cong, C. S. Jensen, and D. Wu. Efficient retrieval of the top-k most relevant spatial web objects. Proc. VLDB Endow., 2:337--348, August 2009.
[11]
N. Craswell, S. Robertson, H. Zaragoza, and M. Taylor. Relevance weighting for query independent evidence. In SIGIR '05, pages 416--423, 2005.
[12]
I. De Felipe, V. Hristidis, and N. Rishe. Keyword search on spatial databases. In ICDE '08, pages 656--665, 2008.
[13]
Z. Dou, R. Song, and J.-R. Wen. A large-scale evaluation and analysis of personalized search strategies. In WWW '07, pages 581--590, 2007.
[14]
H. Fang, T. Tao, and C. Zhai. A formal study of information retrieval heuristics. In SIGIR '04, pages 49--56, 2004.
[15]
J. H. Friedman. Greedy function approximation: A gradient boosting machine. Annals of Statistics, 29:1189--1232, 2000.
[16]
J. H. Friedman. Stochastic gradient boosting. Comput. Stat. Data Anal., 38:367--378, February 2002.
[17]
J. Froehlich, M. Y. Chen, I. E. Smith, and F. Potter. Voting with your feet: An investigative study of the relationship between place visit behavior and preference. In Ubicomp'06, pages 333--350, 2006.
[18]
K. Ganesan and C. Zhai. Opinion-based entity ranking. Information Retrieval, 2011.
[19]
M. A. Hearst and J. O. Pedersen. Reexamining the cluster hypothesis: scatter/gather on retrieval results. In SIGIR '96, pages 76--84, 1996.
[20]
T. Hofmann. Probabilistic latent semantic indexing. In SIGIR '99, pages 50--57, 1999.
[21]
T. Joachims, L. Granka, B. Pan, H. Hembrooke, F. Radlinski, and G. Gay. Evaluating the accuracy of implicit feedback from clicks and query reformulations in web search. ACM Trans. Inf. Syst., 25, April 2007.
[22]
M. Kamvar and S. Baluja. A large scale study of wireless search behavior: Google mobile search. In CHI '06, pages 701--709, 2006.
[23]
M. Kamvar and S. Baluja. Deciphering trends in mobile search. Computer, 40:58--62, August 2007.
[24]
N. D. Lane, D. Lymberopoulos, F. Zhao, and A. T. Campbell. Hapori: context-based local search for mobile phones using community behavioral modeling and similarity. In Ubicomp '10, pages 109--118, 2010.
[25]
Y. Lv and C. Zhai. Lower-bounding term frequency normalization. In CIKM '11, pages 7--16, 2011.
[26]
D. Lymberopoulos, P. Zhao, A. C. König, K. Berberich, and J. Liu. Location-aware click prediction in mobile local search. In CIKM '11, 2011.
[27]
B. Marlin. Modeling user rating profiles for collaborative filtering. In S. Thrun, L. Saul, and B. Schölkopf, editors, Advances in Neural Information Processing Systems 16, Cambridge, MA, 2004. MIT Press.
[28]
N. Matthijs and F. Radlinski. Personalizing web search using long term browsing history. In WSDM '11, pages 25--34, 2011.
[29]
I. Ounis, C. Macdonald, M. de Rijke, G. Mishne, and I. Soboroff. Overview of the trec 2006 blog track. In TREC, 2006.
[30]
S. E. Robertson and S. Walker. Some simple effective approximations to the 2-poisson model for probabilistic weighted retrieval. In SIGIR '94, pages 232--241, 1994.
[31]
M. Sanderson. Test collection based evaluation of information retrieval systems. Foundations and Trends in Information Retrieval, 4(4):247--375, 2010.
[32]
X. Shen, B. Tan, and C. Zhai. Context-sensitive information retrieval using implicit feedback. In SIGIR '05, pages 43--50, 2005.
[33]
A. Singhal, C. Buckley, and M. Mitra. Pivoted document length normalization. In SIGIR '96, pages 21--29, 1996.
[34]
T. Sohn, K. A. Li, W. G. Griswold, and J. D. Hollan. A diary study of mobile information needs. In CHI '08, pages 433--442, 2008.
[35]
K. Sugiyama, K. Hatano, and M. Yoshikawa. Adaptive web search based on user profile constructed without any effort from users. In WWW '04, pages 675--684, 2004.
[36]
B. Tan, X. Shen, and C. Zhai. Mining long-term search history to improve search accuracy. In KDD '06, pages 718--723, 2006.
[37]
J. Teevan, S. T. Dumais, and E. Horvitz. Potential for personalization. ACM Trans. Comput.-Hum. Interact., 17:4:1--4:31, April 2010.
[38]
J. Teevan, A. Karlson, S. Amini, A. J. B. Brush, and J. Krumm. Understanding the importance of location, time, and people in mobile local search behavior. In MobileHCI '11, pages 77--80, 2011.
[39]
L. Wang, C. Wang, X. Xie, J. Forman, Y. Lu, W.-Y. Ma, and Y. Li. Detecting dominant locations from search queries. In SIGIR '05, pages 424--431, 2005.
[40]
Q. Wu, C. J. Burges, K. Svore, and J. Gao. Ranking, boosting, and model adaptation. Technical Report MSR-TR-2008--109, Microsoft Research, 2008.
[41]
J. Yi, F. Maghoul, and J. Pedersen. Deciphering mobile search patterns: a study of yahoo! mobile search queries. In WWW '08, pages 257--266, 2008.
[42]
X. Yi, H. Raghavan, and C. Leggetter. Discovering users' specific geo intention in web search. In WWW '09, pages 481--490, 2009.
[43]
D. Zhang, R. Mao, H. Li, and J. Mao. How to count thumb-ups and thumb-downs: user-rating based ranking of items from an axiomatic perspective. In ICTIR'11, pages 238--249, 2011.

Cited By

View all
  • (2018)Characterizing and Predicting Users’ Behavior on Local Search QueriesACM Transactions on the Web10.1145/315705912:2(1-32)Online publication date: 27-May-2018
  • (2017)Search, Mining, and Their Applications on Mobile DevicesACM Transactions on Information Systems10.1145/308666535:4(1-17)Online publication date: 24-Aug-2017
  • (2016)Improving Local Search with Open Geographic DataProceedings of the 25th International Conference Companion on World Wide Web10.1145/2872518.2890482(635-640)Online publication date: 11-Apr-2016
  • Show More Cited By

Index Terms

  1. An exploration of ranking heuristics in mobile local search

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SIGIR '12: Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval
    August 2012
    1236 pages
    ISBN:9781450314725
    DOI:10.1145/2348283
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 12 August 2012

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. mobile local search
    2. ranking heuristics
    3. search log analysis

    Qualifiers

    • Research-article

    Conference

    SIGIR '12
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 792 of 3,983 submissions, 20%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)3
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 20 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2018)Characterizing and Predicting Users’ Behavior on Local Search QueriesACM Transactions on the Web10.1145/315705912:2(1-32)Online publication date: 27-May-2018
    • (2017)Search, Mining, and Their Applications on Mobile DevicesACM Transactions on Information Systems10.1145/308666535:4(1-17)Online publication date: 24-Aug-2017
    • (2016)Improving Local Search with Open Geographic DataProceedings of the 25th International Conference Companion on World Wide Web10.1145/2872518.2890482(635-640)Online publication date: 11-Apr-2016
    • (2016)Where Can I Buy a Boulder?Proceedings of the 25th International Conference on World Wide Web10.1145/2872427.2882998(1225-1235)Online publication date: 11-Apr-2016
    • (2016)Understanding collaborative search for places of interestJournal of the Association for Information Science and Technology10.1002/asi.2346667:6(1331-1344)Online publication date: 1-Jun-2016
    • (2015)Characterizing and Predicting Viral-and-Popular Video ContentProceedings of the 24th ACM International on Conference on Information and Knowledge Management10.1145/2806416.2806556(1591-1600)Online publication date: 17-Oct-2015
    • (2015)Experiments with a Venue-Centric Model for Personalisedand Time-Aware Venue SuggestionProceedings of the 24th ACM International on Conference on Information and Knowledge Management10.1145/2806416.2806484(53-62)Online publication date: 17-Oct-2015
    • (2015)Location in SearchProceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/2766462.2776783(1083-1083)Online publication date: 9-Aug-2015
    • (2015)Inter-Category Variation in Location SearchProceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/2766462.2767797(863-866)Online publication date: 9-Aug-2015
    • (2015)Finding top-k local users in geo-tagged social media data2015 IEEE 31st International Conference on Data Engineering10.1109/ICDE.2015.7113290(267-278)Online publication date: Apr-2015
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media