poster

A new interpretation of average precision

Author:

SIGIR '08: Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval

Pages 689 - 690

https://doi.org/10.1145/1390334.1390453

Published: 20 July 2008 Publication History

Get Access

Abstract

We consider the question of whether Average Precision, as a measure of retrieval effectiveness, can be regarded as deriving from a model of user searching behaviour. It turns out that indeed it can be so regarded, under a very simple stochastic model of user behaviour.

References

[1]

J. A. Aslam, V. Pavlu, and E. Yilmaz. A statistical method for system evaluation using incomplete judgements. In SIGIR 2006, pages 541--548. ACM Press, 2006.

Digital Library

Google Scholar

[2]

W. S. Cooper. Expected search length: a single measure of retrieval effectiveness based on the weak ordering action of retrieval systems. American Documentation, 19:30--41, 1968.

Crossref

Google Scholar

[3]

G. Kazai and M. Lalmas. Gain measures for the evaluation of content-oriented XML retrieval. ACM Transactions on Information Systems, 24:503--542, 2006.

Digital Library

Google Scholar

[4]

G. Kazai, B. Piwowarski, and S. Robertson. Effort-precision and gain-recall based on a probabilistic navigation model. In S. Dominich and F. Kiss, editors, Studies in theory of information retrieval (Proceedings of ICTIR 2007), pages 23--36, Budapest, 2007. Foundation for Information Society.

Google Scholar

[5]

A. Moffat, W. Webber, and J. Zobel. Strategic system comparisons via targeted relevance judgments. In SIGIR 2007, pages 375--382. ACM Press, 2007.

Digital Library

Google Scholar

[6]

B. Piwowarski and G. Dupret. Evaluation in XML information retrieval: expected precision-recall with user modelling (eprum). In SIGIR 2006, pages 260--267. ACM Press, 2006.

Digital Library

Google Scholar

Cited By

View all

Sun FDu LDai Y(2025)GGSYOLOv5: Flame recognition method in complex scenes based on deep learningPLOS ONE10.1371/journal.pone.031799020:1(e0317990)Online publication date: 31-Jan-2025
https://doi.org/10.1371/journal.pone.0317990
Yuan SZhou QLi JGuo SChen HWu CYang Y(2025)Adaptive Incentive and Resource Allocation for Blockchain-Supported Edge Video Streaming Systems: A Cooperative Learning ApproachIEEE Transactions on Mobile Computing10.1109/TMC.2024.343774524:2(539-556)Online publication date: Feb-2025
https://doi.org/10.1109/TMC.2024.3437745
Xie WWang XMichalski RJia T(2025)Towards a performance characteristic curve for model evaluation: An application in information diffusion predictionExpert Systems with Applications10.1016/j.eswa.2025.126482270(126482)Online publication date: Apr-2025
https://doi.org/10.1016/j.eswa.2025.126482
Show More Cited By

Index Terms

A new interpretation of average precision
1. Information systems
  1. Information retrieval

Recommendations

Extending average precision to graded relevance judgments
SIGIR '10: Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval

Evaluation metrics play a critical role both in the context of comparative evaluation of the performance of retrieval systems and in the context of learning-to-rank (LTR) as objective functions to be optimized. Many different evaluation metrics have ...
Inferring document relevance via average precision
SIGIR '06: Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval

We consider the problem of evaluating retrieval systems using a limited number of relevance judgments. Recent work has demonstrated that one can accurately estimate average precision via a judged pool corresponding to a relatively small random sample of ...
Estimating average precision with incomplete and imperfect judgments
CIKM '06: Proceedings of the 15th ACM international conference on Information and knowledge management

We consider the problem of evaluating retrieval systems using incomplete judgment information. Buckley and Voorhees recently demonstrated that retrieval systems can be efficiently and effectively evaluated using incomplete judgments via the bpref ...

Comments

Information & Contributors

Information

Published In

SIGIR '08: Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval

July 2008

934 pages

ISBN:9781605581644

DOI:10.1145/1390334

General Chairs:
Tat-Seng Chua
National University of Singapore
,
Mun-Kew Leong
National Library Board, Singapore
,
Program Chairs:
Syung Hyon Myaeng
Information and Communications University, Korea
,
Douglas W. Oard
University of Maryland, College Park, USA
,
Fabrizio Sebastiani
Consiglio Nazionale delle Ricerche, Italy

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 July 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster

Conference

SIGIR '08

Sponsor:

SIGIR '08: The 31st Annual International ACM SIGIR Conference

July 20 - 24, 2008

Singapore, Singapore

Acceptance Rates

Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

118
Total Citations
View Citations
1,664
Total Downloads

Downloads (Last 12 months)66
Downloads (Last 6 weeks)6

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Sun FDu LDai Y(2025)GGSYOLOv5: Flame recognition method in complex scenes based on deep learningPLOS ONE10.1371/journal.pone.031799020:1(e0317990)Online publication date: 31-Jan-2025
https://doi.org/10.1371/journal.pone.0317990
Yuan SZhou QLi JGuo SChen HWu CYang Y(2025)Adaptive Incentive and Resource Allocation for Blockchain-Supported Edge Video Streaming Systems: A Cooperative Learning ApproachIEEE Transactions on Mobile Computing10.1109/TMC.2024.343774524:2(539-556)Online publication date: Feb-2025
https://doi.org/10.1109/TMC.2024.3437745
Xie WWang XMichalski RJia T(2025)Towards a performance characteristic curve for model evaluation: An application in information diffusion predictionExpert Systems with Applications10.1016/j.eswa.2025.126482270(126482)Online publication date: Apr-2025
https://doi.org/10.1016/j.eswa.2025.126482
Wetzel SMäs S(2024)Context-Aware Search for Environmental Data Using Dense RetrievalISPRS International Journal of Geo-Information10.3390/ijgi1311038013:11(380)Online publication date: 30-Oct-2024
https://doi.org/10.3390/ijgi13110380
Wu RChunduri PPayani AChu XArulraj JRong K(2024)SketchQL: Video Moment Querying with a Visual Query InterfaceProceedings of the ACM on Management of Data10.1145/36771402:4(1-27)Online publication date: 30-Sep-2024
https://dl.acm.org/doi/10.1145/3677140
Islam TSarker TAhmed KRankrape CGage K(2024)WeedVision: Multi-Stage Growth and Classification of Weeds using DETR and RetinaNet for Precision Agriculture2024 International Conference on Machine Learning and Applications (ICMLA)10.1109/ICMLA61862.2024.00214(1374-1381)Online publication date: 18-Dec-2024
https://doi.org/10.1109/ICMLA61862.2024.00214
Lu HUddin S(2024)A parameterised model for link prediction using node centrality and similarity measure based on graph embeddingNeurocomputing10.1016/j.neucom.2024.127820593(127820)Online publication date: Aug-2024
https://doi.org/10.1016/j.neucom.2024.127820
Iqbal MNaqvi RAlizadehsani RHussain SMoqurrab SLee S(2024)An adaptive ensemble deep learning framework for reliable detection of pandemic patientsComputers in Biology and Medicine10.1016/j.compbiomed.2023.107836168(107836)Online publication date: Jan-2024
https://doi.org/10.1016/j.compbiomed.2023.107836
Abbasian Ardakani AAirom OKhorshidi HBureau NSalvi MMolinari FAcharya U(2024)Interpretation of Artificial Intelligence Models in HealthcareJournal of Ultrasound in Medicine10.1002/jum.1652443:10(1789-1818)Online publication date: 19-Jul-2024
https://doi.org/10.1002/jum.16524
Moffat AMackenzie J(2024)How much freedom does an effectiveness metric really have?Journal of the Association for Information Science and Technology10.1002/asi.24874Online publication date: 15-Feb-2024
https://doi.org/10.1002/asi.24874
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Extending average precision to graded relevance judgments

Inferring document relevance via average precision

Estimating average precision with incomplete and imperfect judgments

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations