首页> 外文会议>IEEE International Conference on Smart Computing >REAM: Resource Efficient Adaptive Monitoring of Community Spaces at the Edge Using Reinforcement Learning
【24h】

REAM: Resource Efficient Adaptive Monitoring of Community Spaces at the Edge Using Reinforcement Learning

机译:REAM:使用强化学习在边缘社区进行资源有效的自适应监视

获取原文

摘要

An increasing number of community spaces are being instrumented with heterogeneous IoT sensors and actuators that enable continuous monitoring of the surrounding environments. Data streams generated from the devices are analyzed using a range of analytics operators and transformed into meaningful information for community monitoring applications. To ensure high quality results, timely monitoring, and application reliability, we argue that these operators must be hosted at edge servers located in close proximity to the community space. In this paper, we present a Resource Efficient Adaptive Monitoring (REAM) framework at the edge that adaptively selects workflows of devices and operators to maintain adequate quality of information for the application at hand while judiciously consuming the limited resources available on edge servers. IoT deployments in community spaces are in a state of continuous flux that are dictated by the nature of activities and events within the space. Since these spaces are complex and change dynamically, and events can take place under different environmental contexts, developing a one-size-fits-all model that works for all types of spaces is infeasible. The REAM framework utilizes deep reinforcement learning agents that learn by interacting with each individual community spaces and take decisions based on the state of the environment in each space and other contextual information. We evaluate our framework on two real-world testbeds in Orange County, USA and NTHU, Taiwan. The evaluation results show that community spaces using REAM can achieve > 90% monitoring accuracy while incurring ~ 50% less resource consumption costs compared to existing static monitoring and Machine Learning driven approaches.
机译:越来越多的社区空间被配备了各种IoT传感器和执行器,以实现对周围环境的连续监控。使用各种分析运算符分析从设备生成的数据流,并将其转换为有意义的信息,以供社区监视应用程序使用。为了确保高质量的结果,及时的监视和应用程序的可靠性,我们认为这些运营商必须托管在紧邻社区空间的边缘服务器上。在本文中,我们在边缘提出了一种资源高效的自适应监视(REAM)框架,该框架自适应地选择设备和操作员的工作流,以为手边的应用程序维持足够的信息质量,同时明智地消耗边缘服务器上可用的有限资源。社区空间中的物联网部署处于不断变化的状态,这由空间中活动和事件的性质决定。由于这些空间是复杂且动态变化的,并且事件可能在不同的环境背景下发生,因此开发适用于所有类型空间的“一刀切”模型是不可行的。 REAM框架利用深度强化学习代理,这些学习代理通过与每个单独的社区空间进行交互来进行学习,并根据每个空间中的环境状态和其他上下文信息来做出决策。我们在美国橙县和台湾NTHU的两个实际测试平台上评估了我们的框架。评估结果表明,与现有的静态监控和机器学习驱动的方法相比,使用REAM的社区空间可以实现> 90%的监控精度,同时减少约50%的资源消耗成本。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号