...
  • 主题
高级搜索  >
历史搜索 清空历史
首页> 外文期刊>International journal of human-computer studies >Do patterns help novice evaluators? A comparative study
【24h】

Do patterns help novice evaluators? A comparative study

机译：模式对新手评估人员有帮助吗？比较研究

获取原文
获取原文并翻译 | 示例
           
页面导航
  • 摘要
  • 著录项
  • 相似文献
  • 相关主题

摘要

Evaluating e-learning systems is a complex activity which requires considerations of several criteria addressing quality in use as well as educational quality. Heuristic evaluation is a widespread method for usability evaluation, yet its output is often prone to subjective variability, primarily due to the generality of many heuristics. This paper presents the pattern-based (PB) inspection, which aims at reducing this drawback by exploiting a set of evaluation patterns to systematically drive inspectors in their evaluation activities. The application of PB inspection to the evaluation of e-learning systems is reported in this paper together with a study that compares this method to heuristic evaluation and user testing. The study involved 73 novice evaluators and 25 end users, who evaluated an e-learning application using one of the three techniques. The comparison metric was defined along six major dimensions, covering concepts of classical test theory and pragmatic aspects of usability evaluation. The study showed that evaluation patterns, capitalizing on the reuse of expert evaluators know-how, provide a systematic framework which reduces reliance on individual skills, increases inter-rater reliability and output standardization, permits the discovery of a larger set of different problems and decreases evaluation cost. Results also indicated that evaluation in general is strongly dependent on the methodological apparatus as well as on judgement bias and individual preferences of evaluators, providing support to the conceptualisation of interactive quality as a subjective judgement, recently brought forward by the UX research agenda.
机译：评估电子学习系统是一项复杂的活动，需要考虑一些涉及使用质量和教育质量的标准。启发式评估是一种广泛的可用性评估方法，但是其输出通常易于主观变异，这主要是由于许多启发式方法的普遍性。本文介绍了基于模式的（PB）检查，其目的是通过利用一组评估模式来系统地推动检查员的评估活动，以减少这种缺陷。本文报告了PB检查在电子学习系统评估中的应用以及一项将这种方法与启发式评估和用户测试进行比较的研究。这项研究涉及73位新手评估人员和25位最终用户，他们使用三种技术之一评估了电子学习应用程序。比较指标是沿着六个主要方面定义的，涵盖了经典测试理论的概念和可用性评估的实用方面。研究表明，利用专家评估员知识的重复利用，评估模式提供了一个系统的框架，该框架减少了对个人技能的依赖，提高了评估者之间的可靠性和产出标准化，可以发现更多的不同问题，并减少评估费用。结果还表明，总体而言，评估在很大程度上依赖于方法论手段以及评估者的偏见和个人偏爱，为交互质量作为主观判断的概念化提供了支持，这是UX研究议程最近提出的。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱：kefu@zhangqiaokeyan.com

京公网安备：11010802029741号 ICP备案号：京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有

  • 客服微信

  • 服务号