Toward a Unified Retrieval Outcome Analysis Framework for Cross-Language Information Retrieval

Description:

This paper proposes a Retrieval Outcome Analysis Framework, or ROA Framework, to systematically evaluate retrieval performance of Cross-Language Information Retrieval systems.

Creator(s): Chen, Jiangping
Creation Date: 2005  
Partner(s):
UNT College of Information
Collection(s):
UNT Scholarly Works
Usage:
Total Uses: 25
Past 30 days: 9
Yesterday: 0
Creator (Author):
Chen, Jiangping

University of North Texas

Date(s):
  • Creation: 2005
Description:

This paper proposes a Retrieval Outcome Analysis Framework, or ROA Framework, to systematically evaluate retrieval performance of Cross-Language Information Retrieval systems.

Degree:
Note:

Abstract: This paper proposes a Retrieval Outcome Analysis Framework, or ROA Framework, to systematically evaluate retrieval performance of Cross-Language Information Retrieval systems. The ROA framework goes beyond TREC-type retrieval evaluation methodology by including procedures focusing on individual queries, especially difficult queries. The framework is comprised of four interrelated components: (1) Overall System Performance Evaluation, (2) Query Categorization, (3) Translation Analysis, and (4) Individual Query Analysis. An example of applying the framework is discussed in detail. The author believes the proposed framework would be especially useful for the development of real world Cross-Language Information Retrieval systems because the evaluation guided by the framework has the potential to discover causes behind poor retrieval performance.

Physical Description:

11 p.

Language(s):
Subject(s):
Keyword(s): cross-language searches | search and retrieval systems | online language translators | retrieval performance evaluation
Source: Sixty-Eighth Annual Meeting of the American Society for Information Science and Technology (ASIS&T), 2005, Charlotte, North Carolina, United States
Contributor(s):
Partner:
UNT College of Information
Collection:
UNT Scholarly Works
Identifier:
  • ARK: ark:/67531/metadc132969
Resource Type: Paper
Format: Text
Rights:
Access: Public