skip to main content
10.1145/1242572.1242731acmconferencesArticle/Chapter ViewAbstractPublication PagesthewebconfConference Proceedingsconference-collections
Article

Automatic search engine performance evaluation with click-through data analysis

Published: 08 May 2007 Publication History

Abstract

Performance evaluation is an important issue in Web search engine researches. Traditional evaluation methods rely on much human efforts and are therefore quite time-consuming. With click-through data analysis, we proposed an automatic search engine performance evaluation method. This method generates navigational type query topics and answers automatically based on search users. querying and clicking behavior. Experimental results based on a commercial Chinese search engine's user logs show that the automatically method gets a similar evaluation result with traditional assessor-based ones.

References

[1]
A. Broder, A taxonomy of Web search. SIGIR Forum Volume 36 Number 2, 2002.
[2]
T. Saracevic, Evaluation of evaluation in information retrieval, Proceedings of the 18th ACM SIGIR, 1995.
[3]
T. Joachims, Evaluating Retrieval Performance Using Clickthrough Data. In SIGIR Workshop, 2002.
[4]
U. Lee, Z. Liu and J. Cho, Automatic Identification of User Goals in Web Search, in the 14th WWW Conference, 2005.
[5]
Y. Liu, M. Zhang, L. Ru and S. Ma, Automatic Query Type Identification Based on Click-through Information, in LNCS 4182, pp. 593--600, 2006.

Cited By

View all

Index Terms

  1. Automatic search engine performance evaluation with click-through data analysis

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    WWW '07: Proceedings of the 16th international conference on World Wide Web
    May 2007
    1382 pages
    ISBN:9781595936547
    DOI:10.1145/1242572
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 08 May 2007

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. click-through data analysis
    2. performance evaluation

    Qualifiers

    • Article

    Conference

    WWW'07
    Sponsor:
    WWW'07: 16th International World Wide Web Conference
    May 8 - 12, 2007
    Alberta, Banff, Canada

    Acceptance Rates

    Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)2
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 17 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Online and Offline Evaluation in Search ClarificationACM Transactions on Information Systems10.1145/368178643:1(1-30)Online publication date: 4-Nov-2024
    • (2022)Federated Search Using Query Log EvidenceProgress in Artificial Intelligence10.1007/978-3-031-16474-3_64(794-805)Online publication date: 13-Sep-2022
    • (2021)Tool to Retrieve Less-Filtered Information from the InternetInformation10.3390/info1202006512:2(65)Online publication date: 4-Feb-2021
    • (2019)Learning to Rank in Entity Relationship GraphsINFORMS Journal on Computing10.1287/ijoc.2018.083731:4(671-688)Online publication date: 7-Jun-2019
    • (2019)Towards Efficient Content Discovery in NDN with Enhanced Component-Based Bloom Filters2019 IEEE 21st International Conference on High Performance Computing and Communications; IEEE 17th International Conference on Smart City; IEEE 5th International Conference on Data Science and Systems (HPCC/SmartCity/DSS)10.1109/HPCC/SmartCity/DSS.2019.00326(2345-2350)Online publication date: Aug-2019
    • (2018)Automatic Evaluation of Video Search engines in Persian Web domain based on Majority VotingSignal and Data Processing10.29252/jsdp.15.3.315:3(3-12)Online publication date: 1-Dec-2018
    • (2017)Evaluating Retrieval Effectiveness by Sustainable Rank ListSustainability10.3390/su90712039:7(1203)Online publication date: 8-Jul-2017
    • (2016)Similarity based Automatic Web Search Engine Evaluation2016 8th International Symposium on Telecommunications (IST)10.1109/ISTEL.2016.7881901(643-648)Online publication date: Sep-2016
    • (2016)A review on web search engines' automatic evaluation methods and how to select the evaluation method2016 Second International Conference on Web Research (ICWR)10.1109/ICWR.2016.7498450(78-83)Online publication date: Apr-2016
    • (2016)Network Information Searching Technology Research Based on Cloud Computing2016 International Conference on Smart Grid and Electrical Automation (ICSGEA)10.1109/ICSGEA.2016.59(132-135)Online publication date: Aug-2016
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media