首页> 外文会议>Automatic Target Recognition XXV >Evaluation methodology for query-based scene understanding systems
【24h】

Evaluation methodology for query-based scene understanding systems

机译:基于查询的场景理解系统的评估方法

获取原文
获取原文并翻译 | 示例

摘要

In this paper, we are proposing a method for the principled evaluation of scene understanding systems in a query-based framework. We can think of a query-based scene understanding system as a generalization of typical sensor exploitation systems where instead of performing a narrowly defined task (e.g., detect, track, classify, etc.), the system can perform general user-defined tasks specified in a query language. Examples of this type of system have been developed as part of DARPA's Mathematics of Sensing, Exploitation, and Execution (MSEE) program. There is a body of literature on the evaluation of typical sensor exploitation systems, but the open-ended nature of the query interface introduces new aspects to the evaluation problem that have not been widely considered before. In this paper, we state the evaluation problem and propose an approach to efficiently learn about the quality of the system under test. We consider the objective of the evaluation to be to build a performance model of the system under test, and we rely on the principles of Bayesian experiment design to help construct and select optimal queries for learning about the parameters of that model.
机译:在本文中,我们提出了一种在基于查询的框架中对场景理解系统进行原则性评估的方法。我们可以将基于查询的场景理解系统视为典型传感器开发系统的概括,其中系统可以执行指定的一般用户定义任务,而不是执行狭窄定义的任务(例如,检测,跟踪,分类等)。以查询语言。作为DARPA的传感,开发和执行数学(MSEE)计划的一部分,已经开发了此类系统的示例。关于典型传感器开发系统的评估,有大量文献,但是查询接口的开放性为评估问题引入了以前未广泛考虑的新方面。在本文中,我们陈述了评估问题,并提出了一种有效地了解被测系统质量的方法。我们认为评估的目的是建立被测系统的性能模型,并且我们依靠贝叶斯实验设计的原理来帮助构建和选择最佳查询,以了解该模型的参数。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号