Biblioteca de la Universidad Complutense de Madrid

Creating the DISEQuA corpus: a test set for multilingual question answering

Impacto



Magnini, Bernardo y Romagnoli, Simone y Vallin, Alessandro y Herrera, Jesús y Peñas, Anselmo y Peinado, Víctor y Verdejo, Felisa y de Rijke, Maarten (2004) Creating the DISEQuA corpus: a test set for multilingual question answering. In : Comparative Evaluation of Multilingual Information Access Systems: 4th Workshop of the Cross-Language Evaluation Forum, CLEF 2003, Trondheim, Norway, August 21-22, 2003, Revised Selected Papers. Lecture Notes in Computer Science, 3237 . Springer-Verlag, Berlin, pp. 487-500. ISBN 3 540 24017 9

[img]
Vista previa
PDF
182kB

URL Oficial: http://www.clef-campaign.org/2003/WN_web/37.pdf



Resumen

This paper describes the procedure adopted by the three coordinators of the CLEF 2003 question answering track (ITC-irst, UNED and ILLC) to create the question set for the monolingual tasks. Despite the few resources available, the three groups managed to formulate and verify a large pool of original questions in three different languages: Dutch, Italian and Spanish. Part of these queries was translated into English and shared between the three coordinating groups. A second cross-verification was then conducted in order to identify the queries that had an answer in all three monolingual document collections. The result of the joint efforts was the creation of the DISEQuA (Dutch Italian Spanish English Questions and Answers) corpus, a useful and reusable resource that is freely available for the research community. We report on the different stages of the corpus creation, from the monolingual kernels to the multilingual extension.


Tipo de documento:Sección de libro
Información Adicional:

Artículo de los organizadores del CLEF 2003.

Palabras clave:Multilingual test set development; Desarrollo de corpus de prueba multilingue; Question answering; Pregunta respuesta; CLEF 2003
Materias:Ciencias > Informática > Inteligencia artificial
Código ID:5535
Depositado:03 Abr 2006
Última Modificación:06 Feb 2014 07:44

Sólo personal del repositorio: página de control del artículo