...
首页> 外文期刊>Educational and Psychological Measurement >Exploring Rating Quality in Rater-Mediated Assessments Using Mokken Scale Analysis
【24h】

Exploring Rating Quality in Rater-Mediated Assessments Using Mokken Scale Analysis

机译:使用Mokken量表分析探索评估者介导的评估中的评估质量

获取原文
获取原文并翻译 | 示例
           

摘要

Mokken scale analysis is a probabilistic nonparametric approach that offers statistical and graphical tools for evaluating the quality of social science measurement without placing potentially inappropriate restrictions on the structure of a data set. In particular, Mokken scaling provides a useful method for evaluating important measurement properties, such as invariance, in contexts where response processes are not well understood. Because rater-mediated assessments involve complex interactions among many variables, including assessment contexts, student artifacts, rubrics, individual rater characteristics, and others, rater-assigned scores are suitable candidates for Mokken scale analysis. The purposes of this study are to describe a suite of indices that can be used to explore the psychometric quality of data from rater-mediated assessments and to illustrate the substantive interpretation of Mokken-based statistics and displays in this context. Techniques that are commonly used in polytomous applications of Mokken scaling are adapted for use with rater-mediated assessments, with a focus on the substantive interpretation related to individual raters. Overall, the findings suggest that indices of rater monotonicity, rater scalability, and invariant rater ordering based on Mokken scaling provide diagnostic information at the level of individual raters related to the requirements for invariant measurement. These Mokken-based indices serve as an additional suite of diagnostic tools for exploring the quality of data from rater-mediated assessments that can supplement rating quality indices based on parametric models.
机译:Mokken规模分析是一种概率性非参数方法,它提供统计和图形工具来评估社会科学测量的质量,而不会对数据集的结构施加潜在的不适当限制。特别是,在对响应过程不太了解的情况下,Mokken定标提供了一种评估重要测量属性(如不变性)的有用方法。由于评估者介导的评估涉及许多变量之间的复杂交互作用,包括评估环境,学生文物,标题,个人评估者特征等,因此评估者分配的分数非常适合进行Mokken量表分析。这项研究的目的是描述一套指标,这些指标可用于探索评估者介导的评估数据的心理计量质量,并说明在这种情况下基于Mokken的统计数据和显示方式的实质性解释。 Mokken缩放的多用途应用中常用的技术适用于评估者介导的评估,重点是与各个评估者相关的实质性解释。总体而言,研究结果表明,基于Mokken缩放比例的评估者单调性,评估者可伸缩性和不变评估者顺序的索引可在与不变性测量要求相关的各个评估者级别上提供诊断信息。这些基于Mokken的索引可作为诊断工具的附加套件,用于探索来自评估者介导的评估的数据质量,这些评估数据可补充基于参数模型的评估质量指数。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号