Magnini, Bernardo and Romagnoli, Simone and Vallin, Alessandro and Herrera, Jesús and Peñas, Anselmo and Peinado, Víctor and Verdejo, Felisa and de Rijke, Maarten (2004) The multiple language question answering track at CLEF 2003. In Comparative Evaluation of Multilingual Information Access Systems: 4th Workshop of the Cross-Language Evaluation Forum, CLEF 2003, Trondheim, Norway, August 21-22, 2003, Revised Selected Papers. Lecture Notes in Computer Science, 3237 . Springer-Verlag, Berlin, pp. 471-486. ISBN 3 540 24017 9
Official URL: http://www.clef-campaign.org/2003/WN_web/36.pdf
This paper reports on the pilot question answering track that was carried out within the CLEF initiative this year. The track was divided into monolingual and bilingual tasks: monolingual systems were evaluated within the frame of three non-English European languages, Dutch, Italian and Spanish, while in the cross-language tasks an English document collection constituted the target corpus for Italian, Spanish, Dutch, French and German queries. Participants were given 200 questions for each task, and were allowed to submit up to two runs per task with up to three responses (either exact answers or 50 byte long strings) per question.
We give here an overview of the track: we report on each task and discuss the creation of the multilingual test sets and the participants results.
|Item Type:||Book Section|
|Additional Information:||Artículo de los organizadores de la tarea de pregunta-respuesta del CLEF 2003.|
|Uncontrolled Keywords:||CLEF 2003; Question answering track; Tarea de pregunta respuesta|
|Subjects:||Sciences > Computer science > Artificial intelligence|
|Deposited On:||03 Apr 2006|
|Last Modified:||06 Feb 2014 07:44|
Repository Staff Only: item control page