...
首页> 外文期刊>Measurement >Exploring the Stability of Differential Item Functioning Across Administrations and Critical Values Using the Rasch Separate Calibration f-test Method
【24h】

Exploring the Stability of Differential Item Functioning Across Administrations and Critical Values Using the Rasch Separate Calibration f-test Method

机译:使用RASCH单独校准F-Test方法探讨跨主管理部门和临界值的差异项目的稳定性

获取原文
获取原文并翻译 | 示例
           

摘要

Differential Item Functioning (DIF) detection procedures provide validity evidence for proposed interpretations of test scores that can help researchers and practitioners ensure that test scores are free from potential bias, and that individual items do not create an advantage for any subgroup of examinees over another. In this study, we use the Rasch separate calibration t-test method to examine the effects of different levels of contrast at varying levels of statistical significance on the flagging of items across multiple examination administrations. We assert that if DIF is a stable trait of an item, it should be sample-independent and detected each time it is administered. We examine the consistency of different alpha levels and critical values in identifying DIF for the same items across multiple administrations. Our results suggest that, using our most lenient criteria, approximately 40% of items on any exam administration may be flagged for DIF, but this drops to 20% when considering items across two administrations, and 12% across three administrations. Testing organizations can use the methods illustrated here to set their own thresholds for DIF, which may be useful if organizations need to estimate the time and cost associated with having independent reviewers examine items.
机译:差分项目功能(DIF)检测程序提供有效证据,了解对研究人员和从业者可以帮助研究人员和从业者的拟议解释,以确保测试分数免受潜在的偏见,并且个别物品对另一个考生的任何子组没有创造优势。在这项研究中,我们使用RASCH单独的校准T检验方法来检查不同水平对比度的不同程度对多种检查主管部门标记的统计显着性。我们断言,如果dif是一个项目的稳定特征,它应该在每次施用时样本和检测到。我们在识别多个管理部门识别相同项目的不同alpha级别和临界值的一致性。我们的研究结果表明,使用我们最宽松的标准,可能会针对任何考试管理的大约40%的项目进行困难,但在考虑两个主管部门的项目时,这降至20%,以及三个主管部门的12%。测试组织可以使用此处说明的方法来为DIF设置自己的阈值,如果组织需要估计与具有独立审阅者相关的时间和成本估算项目的时间和成本可能是有用的。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号