• 主题
高级搜索  >
历史搜索 清空历史
首页> 外文学位 >Investigating the Jusifiability of an Additional Test Use: An Application of Assessment Use Argument to an English as a Foreign Language Test.
【24h】

Investigating the Jusifiability of an Additional Test Use: An Application of Assessment Use Argument to an English as a Foreign Language Test.

机译：调查其他测试用途的合理性：评估使用参数在英语作为外语测试中的应用。

获取原文
获取原文并翻译 | 示例
页面导航
  • 摘要
  • 著录项
  • 相似文献
  • 相关主题

摘要

Multiple uses of the same assessment may present challenges for both the design and use of an assessment. Little advice, however, has been given to assessment developers as to how to understand the phenomena of multiple assessment use and meet the challenges these present. Particularly problematic is the case in which an assessment is used for purposes for which it was not intended or developed. Current frameworks for assessment design and assessment use justification, such as the Messickian conceptualization of a unified validity, an interpretive argument, and the Evidence-Centered Design, provide insight into such issues, but have varying degrees of limitation in guiding the description and evaluation of multiple uses of a given assessment and in relating these uses to assessment design and administration. The present study aims to assist test developers of a college-level English as a Foreign Language (EFL) proficiency test in identifying the most critical area(s) in the current test design and administration for supporting an added use of the testing program. To achieve this goal, the study compared the original and added assessment uses and linked the observed differences to desired modified or additional conditions for justifying the added use. The comparison and linking were guided by the assessment use argument (AUA) framework with expansion proposed by the researcher. Based on the comparison and linking results, five key modified warrants were identified for supporting the added use. Among them, the warrant of the equitability of decisions was identified as the potentially most questionable one. The warrant was elaborated into six sub-warrants, and the backing for each sub-warrant was related to the test design and administration. Two pieces of the backing were then chosen for further investigation. Specifically, information was collected to address issues on the construct of the paper test and the inter-rater inconsistency of the oral test. To facilitate the investigation, structural equation modeling and generalizahility studies were conducted, as well as other procedures including two-group dependent t-tests and Spearman rank-order correlation studies. Based on the study results, it was concluded that the most critical area in the current test design and administration for supporting the added use is likely to be the observed substantial measurement errors of the paper test due to construct-irrelevant factors. Accordingly, test developers are recommended to focus most on identifying construct-irrelevant factors measured in the paper test and addressing them accordingly. Implications and limitations of the study were also discussed.
机译：同一评估的多次使用可能对评估的设计和使用都提出挑战。然而，对于如何理解多重评估的使用现象以及如何应对目前所面临的挑战，评估者几乎没有得到任何建议。尤其有问题的是，将评估用于非预期的目的。当前的评估设计和评估框架使用证明，例如统一有效性的Messick概念化，解释性论证和以证据为中心的设计，可提供对此类问题的见解，但在指导对产品的描述和评估方面存在不同程度的局限性给定评估的多种用途，以及将这些用途与评估设计和管理相关联。本研究旨在帮助大学水平的英语作为外语（EFL）能力测试的测试开发人员确定当前测试设计和管理中最关键的领域，以支持更多使用测试程序。为了实现此目标，研究比较了原始和新增的评估用途，并将观察到的差异与所需的修改或附加条件进行了关联，以证明新增用途的合理性。比较和链接由研究人员提出的评估使用参数（AUA）框架进行扩展。根据比较和链接结果，确定了五种主要的修改后的授权令以支持新增用途。其中，决策公正性的保证被认为是潜在的最有问题的保证。认股权证分为六个子认股权证，每个子认股权证的支持与测试设计和管理有关。然后选择两片支持物进行进一步调查。具体而言，收集信息以解决有关笔试结构和口试的评分者间不一致的问题。为了便于调查，进行了结构方程模型和通用性研究，以及其他程序，包括两组相关的t检验和Spearman秩相关研究。根据研究结果，可以得出结论，在当前的测试设计和管理中，用于支持额外用途的最关键领域可能是由于与构造无关的因素而导致的纸质测试的重大测量误差。因此，建议测试开发人员将重点放在识别纸质测试中测量的与构造无关的因素上，并相应地解决它们。还讨论了研究的意义和局限性。

著录项

  • 作者

    Wang, Huan.;

  • 作者单位

    University of California, Los Angeles.;

  • 授予单位 University of California, Los Angeles.;
  • 学科 Education Tests and Measurements.;Education English as a Second Language.;Language Linguistics.
  • 学位 Ph.D.
  • 年度 2010
  • 页码 160 p.
  • 总页数 160
  • 原文格式 PDF
  • 正文语种 eng
  • 中图分类
  • 关键词

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱：kefu@zhangqiaokeyan.com

京公网安备：11010802029741号 ICP备案号：京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有

  • 客服微信

  • 服务号