Semantic enhancement for legal information retrieval: Iuriservice performance

ABSTRACT

The Iuriservice application offers a semantically enabled FAQ search system and case law browser for the Spanish judges in their first appointment. The system is now at the first stage of implementation in the Spanish Judicial School. Users may input questions to the system in natural language to obtain access to a database of experience-based answers to practical day-to-day questions. In order to offer the question-answer pair from the application database that best matches the input question, the search system is enhanced using ontologies and semantic distance calculation. This paper will focus on the description of these technologies, bringing user needs and ontologies to the spotlight, and will show current effectiveness and efficiency results regarding the performance of the FAQ search engine. These results illustrate the enhancement that may be provided by semantic technologies for information retrieval in comparison with other techniques.

References

1. Benjamins, V. R., Casanovas, P., Gangemi, A., and Breuker, J. Law and the Semantic Web: Legal Ontologies, Methodologies, Legal Information Retrieval, and Applications. (Lecture Notes on Computer Science). Springer Verlag, Berlin-Heidelberg, 2005.
2. Blázquez, M,, Peñna-Ortiz, R., Contreras, J., Benjamins, V. R., Casanovas, P., Vallbé, J. J., and Casellas. N. D10.3.1 Legal Case Study: Prototype. Technical Report SEKT, EU-IST Project IST-2003-506826, iSOCO-IDT (UAB), Madrid-Barcelona, 2005.
3. Boer, A., van Engers, T. M., and Winkels, R. Using ontologies for comparing and harmonizing legislation. In Proceedings of the 9th International Conference on Artificial Intelligence and Law (ICAIL 2003). (June 24--28, 2003). ACM, Edinburgh, Scotland, UK, 2003, 60--69.
4. Böosser, T. and Melchior, E.-M. D8.1.2 User Validation Strategy-approach and methods. Technical Report SEKT, EU-IST Project IST-2003-506826, kea-pro GmbH, Spiringen (Switzerland), 2005.
5. Bösser, T. and Melchior, E.-M. D8.2.2 Users needs and opportunities for business process improvement with knowledge technology. Technical Report SEKT, EU-IST Project IST-2003-506826, kea-pro GmbH, Spiringen (Switzerland), 2006.
6. Breuker, J., Boer, A., Hoekstra, R., and van den Berg, K. Developing Content for LKIF: Ontologies and Frameworks for Legal Reasoning. In van Engers, T. M. (ed.). Legal Knowledge and Information Systems. URIX 2006: The 19th Annual Conference. Vol. 152. IOS Press, Amsterdam, The Netherlands, 2006.
7. Breuker, J., and Winkels, R. Use and reuse of legal ontologies in knowledge engineering and information management. In ICAIL 2003 Workshop on Legal Ontologies and Web Based Legal Information Management. (June 24--28, 2003) Edinburgh, Scotland, UK, 2003.
8. Casanovas P., Poblet, M, Casellas, N., Vallbé, J.-J., Ramos, F., Benjamins, V. R., Blázquez, M., Rodrigo, L., Contreras, J., and Gorroñogoitia Cruz, J. D10.2.1 Legal Case Study: Legal Scenario. Technical Report SEKT, EU-IST Project IST-2003-506826, IDT (UAB)-iSOCO, Barcelona Madrid, 2004. http://www.sekt-project.org/rd/deliverables/wp10/sekt-d-10-2-1-LegalScenario.pdf
9. Casanovas, P., Casellas, N., Tempich, C., Vrandecic, and D., Benjamins, V. R. OPJK modeling methodology. In Lehman, J., Biasiotti, M. A., Francesconi, E., and Sagri, M. T. (eds.). AAIL Proceedings. LOAIT - Legal Ontologies and Artificial Intelligence Techniques (Bologna, Italy, June 2005). Wolf Legal Publishers, Nijmegen, The Netherlands, 2005, 121--133. http://www.aifb.uni-karlsruhe.de/WBS/dvr/publications/loait.pdf
10. Casanovas, P., Poblet, M., Casellas, N., Contreras, J., Benjamins, V. R., and Blázquez, M. Supporting newly-appointed judges: a legal knowledge management case study. Journal of Knowledge Management 9 5 (2005), 7--27.
11. Casanovas, P., Casellas, N., Vallbé, J.-J., Poblet, M., Ramos, F., Gorroñogoitia, J., Contreras, J., Blázquez, M., and Benjamins, V. R. Iuriservice II: Ontology Development and Architectural Design. In Proceedings of the Tenth Internacional Conference on Artificial Intelligence and Law (ICAIL 2005) (Bologna, Italy, June 6--11 2005). Alma Mater Studiorum-University of Bologna, CIRSFID, Bologna, Italy, 2005, 188--194. http://portal.acm.org/citation.cfm?id=1165485. 1165514.
12. Casanovas, P., Casellas, N., Vallbé, J.-J., Poblet, M., Benjamins, V. R., Blázquez, M., Peña-Ortiz, R., and Contreras, J. Semantic Web: A Legal Case Study. In Davies, J., Studer, R., Warren, P. Semantic Web Technologies: Trends and Research in Ontology-based Systems. John Wiley & Sons, Chichester, UK, 2006, 259--280.
13. Casanovas, P., Casellas, N., Vallbé, J.-J., Poblet, M., Blázquez, M., Contreras, J., Benjamins, V. R., and Lpez-Cobo, J.-M. D10.4.1 After Analysis: First steps of the Iuriservice implementation at the Spanish Judicial School. Technical Report SEKT, EU-IST Project IST-2003-506826. IDT (UAB)-iSOCO, Barcelona-Madrid, 2007.
14. Casellas, N., Blázquez, M., Kiryakov, A., Casanovas, P., Poblet, M., and Benjamins, V. R. OPJK into PROTON: legal domain integration into an upper-level ontology. In Meersman, R., Zahir, T., and Herrero, P. (eds.). On the Move to Meaningful Internet Systems 2005 (OTM 2005). WORM: 3rd International Workshop on Regulatory Ontologies (Larnaca, Cyprus, 31 Oct - 4 Nov 2005). Lecture Notes in Computer Science 3762), Springer, Berlin-Heidelberg, 846--855.
15. Casellas, N., Jakulin, A., Vallbé, J.-J., and Casanovas, P. Acquiring an ontology from the text. In Ali, M., Dapoigny, R. (eds.). Advances in Applied Artificial Intelligence, 19th International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems (IEA/AIE 2006) (Annecy, France, June 27--30, 2006), Lecture Notes in Computer Science 4031, Springer, Berlin, 2006, 1000--1013.
16. Davies, J., Studer, R., and Warren, P. Semantic Web Technologies: Trends and Research in Ontology-based Systems. John Wiley & Sons, Chichester, UK, 2006.
17. Duke, A., Glover T., and Stintic, S. D5.2.2 Search and Browse Facility - Final Version. Technical Report SEKT, EU-IST Project IST-2003-506826, BT, London, 2005.
18. Fortuna, B., Grobelnik, M., and Mladenic, D. Semiautomatic construction of topic ontology. In Proceedings of the ECML/PKDD KDO'05 Workshop (Porto, Portugal, October 7th 2005), 2005.
19. Fortuna, B., Grobelnik, M., and Mladenic, D. Semi-automatic Data-driven Ontology Construction System. In Proceedings of the 9th International multi-conference Information Society (IS-2006), Ljubljana, Slovenia, 2006.
20. Fortuna, B. Grobelnik, M., and Mladenic, D. D1.12.1 Optimized Ontology Generation from Scratch. Technical Report SEKT, EU-IST Project IST-2003-506826. Josef Stefan Institute, Ljubljana, Slovenja, 2006.
21. Gangemi, A., and Breuker, J. Harmonising Legal Ontologies. Ontoweb. Technical Report IST Project 2000-2924, 2002.
22. Gangemi, A., Sagri, M., and Tiscornia, D. Metadata for content description in legal information. In ICAIL 2003 Workshop on Legal Ontologies and Web Based Legal Information Management. (June 24--28, 2003) Edinburgh, Scotland, UK, 2003.
23. Huang, Z., and Stuckenschmidt, H.; (2005): D 3.5.1. Reasoning with multiversion ontologies. EU-IST Project IST-2003-506826 SEKT Project Report, Vrije Universiteit of Amsterdam, Amsterdam, 2005.
24. Huang, Z., Schlobach, S., van Harmelen, F., Casellas, N., and Casanovas, P. D3.5.2. Reasoning with Multi-version Ontologies: Evaluation, EU-IST Project IST-2003-506826 SEKT Project Report Report, Vrije Universiteit of Amsterdam, Amsterdam, The Netherlands, 2006
25. Kralingen, van R. W. Frame-based Conceptual Models of Statue Law. Computer Law Series, No. 16. Kluwer Law International. The Hague, The Netherlands, 1995.
26. Lame, G., and Desprès, S. Updating Ontologies in the legal domain. In Proceedings of the Tenth Internacional Conference on Artificial Intelligence and Law (ICAIL 2005) (Bologna, Italy, June 6--11 2005). Alma Mater Studiorum-University of Bologna, CIRSFID, Bologna, Italy, 2005, 155--162.
27. Lehman, J., Biasiotti, M. A., Francesconi, E., and Sagri, M. T. (eds.). AAIL Proceedings. LOAIT - Legal Ontologies and Artificial Intelligence Techniques (Bologna, Italy, June 2005). Wolf Legal Publishers, Nijmegen, The Netherlands, 2005.
28. Llorente, S., Delgado, J., Rodríguez, E., Barrio, R., Longo, I., and Bixio, F. Generation of standarised rights expressions from contacts: an ontology approach? In On the Move to Meaningful Internet Systems 2005 (OTM 2005). WORM: 3rd International Workshop on Regulatory Ontologies (Larnaca, Cyprus, 31 Oct - 4 Nov 2005), 836--845.
29. Pinto, H., Tempich, C., S., and Sure, Y. DILIGENT: Towards a fine-grained methodology for DIstributed, Loosely-controlled and evolvInG Engingeering of oNTologies. In: Proceedings of the 16th European Conference on Artificial Intelligence (ECAI 2004) (August 22nd - 27th, 2004), Valencia, Spain, 2004.
30. Rodrigo, L., Blázquez, M., Casanovas, P., and Poblet, M. Legal Case Study: D10.1.1. Before Analysis. Technical Report SEKT, EU-IST Project IST-2003-506826, iSOCO-IDT (UAB), Madrid-Barcelona, 2004.
31. Rubino, R., Rotolo, A., and Sartor, G. An OWL Ontology of Fundamental Legal Concepts. In van Engers, T. M. (ed.). Legal Knowledge and Information Systems. URIX 2006: The 19th Annual Conference. Vol. 152. IOS Press, Amsterdam, The Netherlands, 2006.
32. Schlobach, S., Huang, Z., and Cornet, R. D3.6.2 Inconsistent Ontology Diagnosis: Evaluation. Technical Report SEKT, EU-IST Project IST-2003-506826, Vrije Universiteit of Amsterdam, Amsterdam, The Netherlands, 2006.
33. Terziev, I., Kiryakov, A., and Manov, D. D 1.8.1. Base upper-level ontology (BULO) Guidance. Technical Report SEKT, EU-IST Project IST-2003-506826, SIRMA, Sofia, Bulgary, 2004. http://proton.semanticweb.org/D1_8_1.pdf
34. Valente, A., Breuker, J., and Brouwer, B. Legal modeling and automated reasoning with ON-LINE. International Journal of Human-Computer Studies 51 (1999), 1079--1125.
35. Visser, P. R. S., and Bench Capon, T. J. M. A comparison of four ontologies for the design of legal knowledge systems. Artificial Intelligence and Law 6 (1998), 27--57.

Index Terms

• Applied computing

  • Law, social and behavioral sciences

    • Law

  • Operations research

    • Decision analysis

• Information systems

  • Information retrieval

    • Evaluation of retrieval results

  • Information systems applications

    • Decision support systems