Influence of Item Response Theory and Type of Judge on a Standard Set Using the Iterative Angoff Standard Setting Method Page: 40
This dissertation is part of the collection entitled: UNT Theses and Dissertations and was provided to UNT Digital Library by the UNT Libraries.
Extracted Text
The following text was automatically extracted from the image on this page using optical character recognition software:
40
for each judge group are displayed in Table 2. Inspection
of the four group means shows a difference of 34.19 between
the lowest and highest mean minimum pass level. The
difference between the mean minimum pass levels of the two
groups supplied with p-values (the traditional method) was
4.68, while the difference between the mean minimum pass
levels of the two groups supplied with b-values (the item
response theory method) was 22.16. The difference between
the mean minimum pass levels of the two groups of non-
classroom judges was 29.51, while the difference between
the mean minimum pass levels of the two groups of classroom
judges was 12.03. The results of a two-way analysis of
variance (see Table 3) indicate that the interaction
between judge type and method was significant (p < .001).
The significant ordinal interaction between judge type and
standard setting method is shown in Figure 1. Because
significant interaction effects were found, main effects
were not interpreted.
The second research question investigated the effects
of judge type and standard setting method on the variance
of the standard. Minimum pass level variance means and
standard deviations are provided in Table 4. Results of a
two-way analysis of variance on minimum pass level
variability are shown in Table 5. Based on this analysis,
a significant interaction was found between judge type and
method (p < .001). The significant disordinal interaction
Upcoming Pages
Here’s what’s next.
Search Inside
This dissertation can be searched. Note: Results may vary based on the legibility of text within the document.
Tools / Downloads
Get a copy of this page or view the extracted text.
Citing and Sharing
Basic information for referencing this web page. We also provide extended guidance on usage rights, references, copying or embedding.
Reference the current page of this Dissertation.
Hamberlin, Melanie Kidd. Influence of Item Response Theory and Type of Judge on a Standard Set Using the Iterative Angoff Standard Setting Method, dissertation, August 1992; Denton, Texas. (https://digital.library.unt.edu/ark:/67531/metadc332675/m1/47/: accessed May 1, 2024), University of North Texas Libraries, UNT Digital Library, https://digital.library.unt.edu; .