Search Results

Comparing outcome measures derived from four research designs incorporating the retrospective pretest.

Description: Over the last 5 decades, the retrospective pretest has been used in behavioral science research to battle key threats to the internal validity of posttest-only control-group and pretest-posttest only designs. The purpose of this study was to compare outcome measures resulting from four research design implementations incorporating the retrospective pretest: (a) pre-post-then, (b) pre-post/then, (c) post-then, and (d) post/then. The study analyzed the interaction effect of pretest sensitization and post-intervention survey order on two subjective measures: (a) a control measure not related to the intervention and (b) an experimental measure consistent with the intervention. Validity of subjective measurement outcomes were assessed by correlating resulting to objective performance measurement outcomes. A Situational Leadership® II (SLII) training workshop served as the intervention. The Work Involvement Scale of the self version of the Survey of Management Practices Survey served as the subjective control measure. The Clarification of Goals and Objectives Scale of the self version of the Survey of Management Practices Survey served as the subjective experimental measure. The Effectiveness Scale of the self version of the Leader Behavior Analysis II® served as the objective performance measure. This study detected differences in measurement outcomes from SLII participant responses to an experimental and a control measure. In the case of the experimental measure, differences were found in the magnitude and direction of the validity coefficients. In the case of the control measure, differences were found in the magnitude of the treatment effect between groups. These differences indicate that, for this study, the pre-post-then design produced the most valid results for the experimental measure. For the control measure in this study, the pre-post/then design produced the most valid results. Across both measures, the post/then design produced the least valid results.
Date: August 2007
Creator: Nimon, Kim F.
Partner: UNT Libraries

The assumption of a reliable instrument and other pitfalls to avoid when considering the reliability of data

Description: This article helps researchers avoid common pitfalls associated with reliability including incorrectly assuming that measurement error always attenuates observed score correlations, different sources of measurement error originate from the same source, and reliability is a function of instrumentation.
Date: April 12, 2012
Creator: Nimon, Kim F.; Zientek, Linda Reichwein & Henson, Robin K.
Partner: UNT College of Arts and Sciences

Tools to support interpreting multiple regression in the face of multicollilnearity

Description: This article argues that rather than using one technique to investigate regression results, researchers should consider multiple indices to understand the contributions that predictors make not only to a regression model, but to each other as well.
Date: March 14, 2012
Creator: Kraha, Amanda; Turner, Heather; Nimon, Kim F.; Zientek, Linda Reichwein & Henson, Robin K.
Partner: UNT College of Information