首页> 外文会议>IEEE/RSJ International Conference on Intelligent Robots and Systems >Latent Space Roadmap for Visual Action Planning of Deformable and Rigid Object Manipulation
【24h】

Latent Space Roadmap for Visual Action Planning of Deformable and Rigid Object Manipulation

机译:可变形和刚性物体操纵可视动作规划的潜在空间路线图

获取原文

摘要

We present a framework for visual action planning of complex manipulation tasks with high-dimensional state spaces such as manipulation of deformable objects. Planning is performed in a low-dimensional latent state space that embeds images. We define and implement a Latent Space Roadmap (LSR) which is a graph-based structure that globally captures the latent system dynamics. Our framework consists of two main components: a Visual Foresight Module (VFM) that generates a visual plan as a sequence of images, and an Action Proposal Network (APN) that predicts the actions between them. We show the effectiveness of the method on a simulated box stacking task as well as a T-shirt folding task performed with a real robot.
机译:我们为具有高维状态空间的复杂操作任务的视觉行动计划提供了一个框架,例如可操作可变形对象。规划是在嵌入图像的低维潜在的空间中进行的。我们定义并实施潜在的空间路线图(LSR),它是基于图形的结构,该结构是全球捕获潜在系统动态。我们的框架由两个主要组件组成:Visual BeeSight模块(VFM),它生成视觉计划作为图像序列,以及预测它们之间的动作的动作提案网络(APN)。我们展示了该方法对模拟箱堆垛机的有效性以及用真正的机器人执行的T恤折叠任务。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号