首页> 外国专利> MODELING OF LONG-RANGE INTERACTIONS WITH REDUCED FEATURE MATERIALIZATION VIA LAMBDA FUNCTIONS

MODELING OF LONG-RANGE INTERACTIONS WITH REDUCED FEATURE MATERIALIZATION VIA LAMBDA FUNCTIONS

机译:通过Lambda函数模拟远程相互作用

摘要

The present disclosure provides systems, methods, and computer program products for performing modeling of long-range interactions with reduced feature materialization, for example, in machine learning models. A computer-implemented method may include receiving a layer input comprising input data and context data, generating one or more lambda functions based, at least in part, on a content function and a position function for each of a plurality of context elements in the context data, and applying one or more of the generated lambda functions to the input data in association with generating a layer output associated with a respective lambda layer. Experimental results for image classification on ResNet and for object detection with RetinaNet show that examples of the present disclosure significantly outperform convolutional and attentional counterparts while providing increased accuracy and efficiency.
机译:本公开提供了用于在机器学习模型中执行与减少特征实现的远程相互作用的建模的系统,方法和计算机程序产品。 计算机实现的方法可以包括接收包括输入数据和上下文数据的层输入,至少部分地基于内容函数和上下文元素中的每一个的内容函数和位置函数来生成一个或多个lambda函数 数据,以及将一个或多个生成的Lambda函数与生成与相应的Lambda层相关联的层输出相关联地。 Reset上的图像分类和具有RetinAnet的对象检测的实验结果表明,本公开的示例显着优于卷积和注意力对应物,同时提供提高的精度和效率。

著录项

  • 公开/公告号WO2022015546A1

    专利类型

  • 公开/公告日2022-01-20

    原文格式PDF

  • 申请/专利权人 GOOGLE LLC;

    申请/专利号WO2021US40664

  • 发明设计人 BELLO IRWAN;

    申请日2021-07-07

  • 分类号G06N3/04;G06N3/08;

  • 国家 US

  • 入库时间 2022-08-24 23:29:33

相似文献

  • 专利
  • 外文文献
  • 中文文献
获取专利

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号