| Description: | This paper proposes a Retrieval Outcome Analysis Framework, or ROA Framework, to systematically evaluate retrieval performance of Cross-Language Information Retrieval systems. The ROA framework goes beyond TREC-type retrieval evaluation methodology by including procedures focusing on individual queries, especially difficult queries. The framework is comprised of four interrelated components: (1) Overall System Performance Evaluation, (2) Query Categorization, (3) Translation Analysis, and (4) Individual Query Analysis. An example of applying the framework is discussed in detail. The author believes the proposed framework would be especially useful for the development of real world Cross-Language Information Retrieval systems because the evaluation guided by the framework has the potential to discover causes behind poor retrieval performance. |
|---|---|
| Creator(s): | Chen, Jiangping |
| Creation Date: | 2005 |
| Partner(s): |
UNT College of Information
|
| Collection(s): |
UNT Scholarly Works
|
| Usage: |
Total Uses: 8
Past 30 days: 0
Yesterday: 0
|
| Creator (Author): |
Chen, Jiangping
University of North Texas |
|
|---|---|---|
| Original Creation Date: | 2005 | |
| Description: | This paper proposes a Retrieval Outcome Analysis Framework, or ROA Framework, to systematically evaluate retrieval performance of Cross-Language Information Retrieval systems. The ROA framework goes beyond TREC-type retrieval evaluation methodology by including procedures focusing on individual queries, especially difficult queries. The framework is comprised of four interrelated components: (1) Overall System Performance Evaluation, (2) Query Categorization, (3) Translation Analysis, and (4) Individual Query Analysis. An example of applying the framework is discussed in detail. The author believes the proposed framework would be especially useful for the development of real world Cross-Language Information Retrieval systems because the evaluation guided by the framework has the potential to discover causes behind poor retrieval performance. |
|
| Degree: |
Department:
Library and Information Science
|
|
| Physical Description: |
11 p. |
|
| Language(s): | ||
| Subject(s): |
|
|
| Keyword(s): | cross-language searches | search and retrieval systems | online language translators | retrieval performance evaluation | |
| Source: | Sixty-Eighth Annual Meeting of the American Society for Information Science and Technology (ASIS&T), 2005, Charlotte, North Carolina, United States | |
| Contributor(s): |
|
|
| Partner: |
UNT College of Information
|
|
| Collection: |
UNT Scholarly Works
|
|
| Identifier: |
|
|
| Resource Type: | Paper | |
| Format: | Text | |
| Rights: |
Access:
Public
|
|
