Creator: Chen, Jiangping; Ding, Ren; Jiang, Shan & Knudson, Ryan
Description: This article discusses a preliminary evaluation study of metadata records machine translation. This study is partially supported by the Institute of Museum and Library Services (IMLS) grant LG-06-10-0162-10. Purpose: The purpose of this study is to evaluate freely available machine translation (MT) services' performance in translating metadata records. Design/methodology/approach: Randomly selected metadata records were translated from English to Chinese using Google, Bing, and SYSTRAN MT systems. These translations were then evaluated using a five point scale for both fluency and adequacy. Missing count (words not translated) and incorrect count (words incorrectly translated) were also recorded. Findings: Concerning both fluency and adequacy, Google and Bing's translations of more than 70 percent of test data received scores equal to or greater than three, representative of "non-native Chinese" and "much coverage," respectively. SYSTRAN scored lowest in both measures. However, these differences were not statistically significant. A Pearson correlation analysis demonstrated a strong relationship (r=0.86) between fluency and adequacy. Missing count and incorrect count strongly correlated with fluency and adequacy. Originality/value: Most existing digital collections can be accessed in English alone. Few digital collections in the USA support multilingual information access (MLIA) that enables users of differing languagees to search, browse, recognize and use ...
Contributing Partner: UNT College of Information