Automatic Language Identification for Metadata Records: Measuring the Effectiveness of Various Approaches

Thumbnail image of item number 1 in: 'Automatic Language Identification for Metadata Records: Measuring the Effectiveness of Various Approaches'.
Thumbnail image of item number 2 in: 'Automatic Language Identification for Metadata Records: Measuring the Effectiveness of Various Approaches'.
Thumbnail image of item number 3 in: 'Automatic Language Identification for Metadata Records: Measuring the Effectiveness of Various Approaches'.
Thumbnail image of item number 4 in: 'Automatic Language Identification for Metadata Records: Measuring the Effectiveness of Various Approaches'.
Showing 1-4 of 98 pages in this dissertation.

PDF Version Also Available for Download.

Description

Automatic language identification has been applied to short texts such as queries in information retrieval, but it has not yet been applied to metadata records. Applying this technology to metadata records, particularly their title elements, would enable creators of metadata records to obtain a value for the language element, which is often left blank due to a lack of linguistic expertise. It would also enable the addition of the language value to existing metadata records that currently lack a language value. Titles lend themselves to the problem of language identification mainly due to their shortness, a factor which increases the … continued below

Physical Description

v, 92 pages : illustrations (some color)

Creation Information

Knudson, Ryan Charles May 2015.

Context

This dissertation is part of the collection entitled: UNT Theses and Dissertations and was provided by the UNT Libraries to the UNT Digital Library, a digital repository hosted by the UNT Libraries. It has been viewed 342 times. More information about this dissertation can be viewed below.

Who

People and organizations associated with either the creation of this dissertation or its content.

Author

Chair

Committee Members

Publisher

Rights Holder

For guidance see Citations, Rights, Re-Use.

  • Knudson, Ryan Charles

Provided By

UNT Libraries

The UNT Libraries serve the university and community by providing access to physical and online collections, fostering information literacy, supporting academic research, and much, much more.

About | Browse this Partner

Contact Us

Corrections Questions

What

Descriptive information to help identify this dissertation. Follow the links below to find similar items on the Digital Library.

Degree Information

Description

Automatic language identification has been applied to short texts such as queries in information retrieval, but it has not yet been applied to metadata records. Applying this technology to metadata records, particularly their title elements, would enable creators of metadata records to obtain a value for the language element, which is often left blank due to a lack of linguistic expertise. It would also enable the addition of the language value to existing metadata records that currently lack a language value. Titles lend themselves to the problem of language identification mainly due to their shortness, a factor which increases the difficulty of accurately identifying a language. This study implemented four proven approaches to language identification as well as one open-source approach on a collection of multilingual titles of books and movies. Of the five approaches considered, a reduced N-gram frequency profile and distance measure approach outperformed all others, accurately identifying over 83% of all titles in the collection. Future plans are to offer this technology to curators of digital collections for use.

Physical Description

v, 92 pages : illustrations (some color)

Language

Item Type

Identifier

Unique identifying numbers for this dissertation in the Digital Library or other systems.

Collections

This dissertation is part of the following collection of related materials.

UNT Theses and Dissertations

Theses and dissertations represent a wealth of scholarly and artistic content created by masters and doctoral students in the degree-seeking process. Some ETDs in this collection are restricted to use by the UNT community.

About | Browse this Collection

What responsibilities do I have when using this dissertation?

Digital Files

When

Dates and time periods associated with this dissertation.

Creation Date

  • May 2015

Added to The UNT Digital Library

  • Feb. 9, 2016, 4:37 p.m.

Description Last Updated

  • April 2, 2020, 10:18 a.m.

Usage Statistics

When was this dissertation last used?

Yesterday: 0
Past 30 days: 1
Total Uses: 342
More Statistics

Interact With This Dissertation

Here are some suggestions for what to do next.

Start Reading

Thumbnail image of item number 1 in: 'Automatic Language Identification for Metadata Records: Measuring the Effectiveness of Various Approaches'.
Thumbnail image of item number 2 in: 'Automatic Language Identification for Metadata Records: Measuring the Effectiveness of Various Approaches'.
Thumbnail image of item number 3 in: 'Automatic Language Identification for Metadata Records: Measuring the Effectiveness of Various Approaches'.
Thumbnail image of item number 4 in: 'Automatic Language Identification for Metadata Records: Measuring the Effectiveness of Various Approaches'.

PDF Version Also Available for Download.

Citations, Rights, Re-Use

International Image Interoperability Framework

IIF Logo

We support the IIIF Presentation API

Links for Robots

Helpful links in machine-readable formats.

Archival Resource Key (ARK)

International Image Interoperability Framework (IIIF)

Metadata Formats

Images

URLs

Stats

Knudson, Ryan Charles. Automatic Language Identification for Metadata Records: Measuring the Effectiveness of Various Approaches, dissertation, May 2015; Denton, Texas. (https://digital.library.unt.edu/ark:/67531/metadc801895/: accessed July 16, 2024), University of North Texas Libraries, UNT Digital Library, https://digital.library.unt.edu; .

Back to Top of Screen