This presentation discusses the MARC Content Designation Utilization (MCDU) Project. It presents information about the goals and scope of the project, the methodology and information about the process, and the implications of this project.
In this document, the authors present some aspects of data normalization of the decomposed records to improve the results of analysis. The data normalization processes use pattern-matching techniques to eliminate and/or generalize anomalous characters and terms. Since the unit of analysis in preparing the test dataset of 400,000 MARC 21 records is a "word," there was a need for data normalization to provide reliability in the subsequent analysis.