A Quasi-Experimental Study of Inter-rater Reliability When Awarding Exceptional Quality Points on the Texas Teacher Appraisal Instrument

PDF Version Also Available for Download.

Description

This study investigates the inter-rater reliability of appraisers who award exceptional quality points on the Texas Teacher Appraisal Instrument. Inter-rater reliability was measured when appraisers scored exceptional quality points after viewing a videotaped lesson. Comparisons were made between appraisers when grouped according to elementary or secondary certification, sex, years of administrative experience, and type of training. A total of 707 subjects from 56 school districts participated in the study. Five research hypotheses were formulated with the .05 level of significance for acceptance. All hypotheses were tested by correlation of coefficients, multiple response procedures, frequencies, and percentages. The data measuring inter-rater ... continued below

Physical Description

vi, 129 leaves

Creation Information

Dobbs, Louann August 1989.

Context

This dissertation is part of the collection entitled: UNT Theses and Dissertations and was provided by UNT Libraries to Digital Library, a digital repository hosted by the UNT Libraries. It has been viewed 53 times , with 4 in the last month . More information about this dissertation can be viewed below.

Who

People and organizations associated with either the creation of this dissertation or its content.

Author

Chair

Committee Members

Publisher

Rights Holder

For guidance see Citations, Rights, Re-Use.

  • Dobbs, Louann

Provided By

UNT Libraries

With locations on the Denton campus of the University of North Texas and one in Dallas, UNT Libraries serves the school and the community by providing access to physical and online collections; The Portal to Texas History and UNT Digital Libraries; academic research, and much, much more.

Contact Us

What

Descriptive information to help identify this dissertation. Follow the links below to find similar items on the Digital Library.

Degree Information

Description

This study investigates the inter-rater reliability of appraisers who award exceptional quality points on the Texas Teacher Appraisal Instrument. Inter-rater reliability was measured when appraisers scored exceptional quality points after viewing a videotaped lesson. Comparisons were made between appraisers when grouped according to elementary or secondary certification, sex, years of administrative experience, and type of training. A total of 707 subjects from 56 school districts participated in the study. Five research hypotheses were formulated with the .05 level of significance for acceptance. All hypotheses were tested by correlation of coefficients, multiple response procedures, frequencies, and percentages.
The data measuring inter-rater reliability of the appraisers in training imply that there is very little reliability in the awarding of exceptional quality points on the Texas Teacher Appraisal Instrument. The findings of this study are that certification, sex, administrative experience, and type of training made no significant differences when scoring the instrument. Therefore, it is concluded that the scoring of exceptional quality points is a subjective, professional judgment made by each appraiser when observing a teacher. Since no significant reliability was found, the scoring of exceptional quality points cannot be supported as a reliable means of determining the quality of teaching in Texas schools. Generally, elementary certified appraisers awarded fewer exceptional quality points than secondary appraisers, males awarded slightly more points than females, appraisers indicated no noticeable trend because of years of administrative experience, and less experienced appraisers had the tendency to award more points than experienced appraisers.
Therefore, inter-rater reliability in awarding exceptional quality points cannot be expected on a consistent basis. Each appraiser, regardless of certification, sex, years of administrative experience or training, will use his or her own professional judgment when scoring the instrument.

Physical Description

vi, 129 leaves

Language

Identifier

Unique identifying numbers for this dissertation in the Digital Library or other systems.

Collections

This dissertation is part of the following collection of related materials.

UNT Theses and Dissertations

Theses and dissertations represent a wealth of scholarly and artistic content created by masters and doctoral students in the degree-seeking process. Some ETDs in this collection are restricted to use by the UNT community.

What responsibilities do I have when using this dissertation?

When

Dates and time periods associated with this dissertation.

Creation Date

  • August 1989

Added to The UNT Digital Library

  • Aug. 22, 2014, 6 p.m.

Description Last Updated

  • Sept. 21, 2015, 2:40 p.m.

Usage Statistics

When was this dissertation last used?

Yesterday: 0
Past 30 days: 4
Total Uses: 53

Where

Geographical information about where this dissertation originated or about its content.

Publication Place

Map Information

  • map marker Automatically generated Place Name coordinates.
  • map marker Automatically generated Publication Place coordinates.
  • Repositioning map may be required for optimal printing.

Mapped Locations

Interact With This Dissertation

Here are some suggestions for what to do next.

Start Reading

PDF Version Also Available for Download.

Citations, Rights, Re-Use

Dobbs, Louann. A Quasi-Experimental Study of Inter-rater Reliability When Awarding Exceptional Quality Points on the Texas Teacher Appraisal Instrument, dissertation, August 1989; Denton, Texas. (digital.library.unt.edu/ark:/67531/metadc331185/: accessed September 22, 2017), University of North Texas Libraries, Digital Library, digital.library.unt.edu; .