Gérard M. Dupont
ABSTRACT
This paper describes a software architecture designed to enable the evaluation of information processing and retrieval systems. The overall objective of our project is to provide an open technical framework for the integration of tools for collection, processing, analysis and communication of open source information1. However, enabling the integration of heterogeneous components does not make sense without a proper way to compare the capabilities of multiple tools.
Thus, as part of the architecture the VIRTUOSO platform offers an evaluation framework which allows one to deploy and run evaluation kits for different use-cases.
- G. Canet, G. de Chalendar, L. Dubost, G. Dupont, A. Dyevre, and K. Khelif. Toward a versatile information toolkit for end-users oriented open-sources exploitation : VIRTUOSO. In "Sources Ouvertes et Services" - SOS'2011, En association avec EGC'2011, 2011.Google Scholar
- C. W. Cleverdon. Report on the testing and analysis of an investigation into the comparative efficiency of indexing systems. Technical report, Cranfield Coll. of Aeronautics, Cranfield, England, 1962.Google Scholar
- M. Dittenbach, B. Pflugfelder, A. Pesenhofer, G. Roda, and H. Berger. Soire: a service-oriented ir evaluation architecture. In Proceeding of the 18th ACM conference on Information and knowledge management, CIKM '09, pages 2101--2102, New York, NY, USA, 2009. ACM. Google ScholarDigital Library
- S. T. Dumais and N. Belkin. TREC: Experiment and Evaluation in Information Retrieval, chapter The Interactive TREC Track: Putting the user into search., pages 123--153. E. Voorhees and D. Harman (Eds.), MIT Press, 2005.Google Scholar
- P. Giroux, S. Brunessaux, S. Brunessaux, J. Doucy, G. Dupont, B. Grilheres, Y. Mombrun, and A. Saval. Weblab: An integration infrastructure to ease the development of multimedia processing applications. ICSSEA, 2008.Google Scholar
- R. W. Group. Resource description framework (rdf): Concepts and abstract syntax. Technical report, W3C, 2004.Google Scholar
- P. Thompson, H. Turtle, B. Yang, and J. Flood. Trec-3 ad-hoc retrieval and routing experiments using the win system. In Gaithersburg, editor, Proc. of the Text REtrieval Conference, pages 211--218, USA, 1995.Google Scholar
Index Terms
- Evaluation with the VIRTUOSO platform: an open source platform for information extraction and retrieval evaluation
Recommendations
A functional component framework for integration infrastructures
Enterprises cooperate extensively with other enterprises in various forms. These collaboration forms need suitable infrastructures and supporting applications to realise the collaboration. This paper presents ideas and requirements for an integration ...
Virtuoso: Narrowing the Semantic Gap in Virtual Machine Introspection
SP '11: Proceedings of the 2011 IEEE Symposium on Security and PrivacyIntrospection has featured prominently in many recent security solutions, such as virtual machine-based intrusion detection, forensic memory analysis, and low-artifact malware analysis. Widespread adoption of these approaches, however, has been hampered ...
An Extendable OpenSource Architecture of E-Learning System
ECONF '13: Proceedings of the 2013 Fourth International Conference on e-Learning "Best Practices in Management, Design and Development of e-Courses: Standards of Excellence and Creativity"In this paper, we present an extendable open source architecture and model of an e-Learning system. The system composed of essential e-Learning core components and optional open source extensions. Open source extensions, developed and maintain by open ...
Comments