首页> 外文期刊>Learning Technologies, IEEE Transactions on >The Effects of Dispersion and Reciprocity on Assessment Fidelity in Peer-Review Systems: A Simulation Study
【24h】

The Effects of Dispersion and Reciprocity on Assessment Fidelity in Peer-Review Systems: A Simulation Study

机译:分散和互惠对同行评审系统评估保真度的影响:模拟研究

获取原文
获取原文并翻译 | 示例
           

摘要

Over the last 20 years, online peer review and assessment have become widely used and well-researched practices in education. Their use increased, especially with the proliferation of nonconventional large-scale and online modes of teaching and learning, such as Massive Open Online Courses (MOOCs). A well-designed peer-review system is expected to produce valid and reliable assessments of the artifacts created by participants. These systems notably vary in designs, particularly in the structure of the peer-review networks, i.e., how participants are linked to each other as creators and reviewers. To date, little research has been done on how different network structures impact a system's ability to accurately assess the quality of the evaluated artifacts. We begin to address this gap, using a simulation approach to demonstrate that two network characteristics-dispersion and reciprocity-may indeed affect assessment fidelity in peer-review systems in conjunction with other design choices, such as evaluation scale and aggregation method. We also outline directions for further investigations of peer-review systems design.
机译:在过去的20年中,在线同行评审和评估已被广泛使用和研究的高等教育实践。他们的用途增加了,特别是在大规模的大规模和在线教学模式的扩散,如大规模开放的在线课程(Moocs)。预计设计精心设计的同行评审系统将为参与者创建的工件产生有效且可靠的评估。这些系统在设计中尤其变化,特别是在对等审查网络的结构中,即参与者如何彼此作为创造者和审稿人。迄今为止,在不同的网络结构如何影响系统的准确评估评估伪影的质量的能力上,已经完成了很少的研究。我们开始解决这个差距,使用模拟方法来证明两个网络特征 - 色散和互惠 - 可以确实在与其他设计选择中结合同行评估系统中的评估保真度,例如评估规模和聚合方法。我们还为进一步调查对等审查系统设计的进一步调查。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号