• 主题
高级搜索  >
历史搜索 清空历史
首页> 外文会议>IEEE International Conference on Distributed Computing Systems >λ-NIC: Interactive Serverless Compute on Programmable SmartNICs
【24h】

λ-NIC: Interactive Serverless Compute on Programmable SmartNICs

机译：λ-NIC：可编程SmartNICS上的交互式无法控制

获取原文
页面导航
  • 摘要
  • 著录项
  • 相似文献
  • 相关主题

摘要

There is a growing interest in serverless compute, a cloud computing model that automates infrastructure resource- allocation and management while billing customers only for the resources they use. Workloads like stream processing benefit from high elasticity and fine-grain pricing of these serverless frameworks. However, so far, limited concurrency and high latency of server CPUs prohibit many interactive workloads (e.g., web servers and database clients) from taking advantage of serverless compute to achieve high performance.In this paper, we argue that server CPUs are ill-suited to run serverless workloads (i.e., lambdas) and present λ-NIC, an open- source framework, that runs interactive workloads directly on a SmartNIC; more specifically an ASIC-based NIC that consists of a dense grid of Network Processing Unit (NPU) cores. λ- NIC leverages SmartNIC’s proximity to the network and a vast array of NPU cores to simultaneously run thousands of lambdas on a single NIC with strict tail-latency guarantees. To ease the development and deployment of lambdas, λ-NIC exposes an event-based programming abstraction, Match+Lambda, and a machine model that allows developers to compose and execute lambdas on SmartNICs easily. Our evaluation shows that λ- NIC achieves up to 880x and 736x improvements in workloads’ response latency and throughput, respectively, while significantly reducing host CPU and memory usage.
机译：对无服务器计算的兴趣日益增长，这是一种云计算模型，可自动化基础架构资源分配和管理，同时仅计为客户使用的资源。工作负载等流处理中受到这些无服务器框架的高弹性和细粒度定价。然而，到目前为止，到目前为止，服务器CPU的有限并发性和高延迟禁止许多交互式工作负载（例如，Web服务器和数据库客户端），从利用无服务器计算来实现高性能。在本文中，我们认为服务器CPU不适合运行无服务器工作负载（即lambdas）并显示一个开源框架，可以直接在Smartnic上运行交互式工作负载;更具体地是基于ASIC的NIC，其由网络处理单元（NPU）核心的密集网格组成。 λ-网卡利用Smartnic对网络的靠近以及大量的NPU核心，同时在单个NIC上同时运行数千个Lambdas，严格的尾随延迟保证。为了简化Lambdas的开发和部署，λ-NIC公开了一种基于事件的编程抽象，匹配+ Lambda和机器模型，允许开发人员轻松地在Smartnics上撰写和执行Lambdas。我们的评估表明，λ-nic分别实现了高达880倍和736倍的工作量的响应延迟和吞吐量，同时显着减少了主CPU和内存使用情况。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱：kefu@zhangqiaokeyan.com

京公网安备：11010802029741号 ICP备案号：京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有

  • 客服微信

  • 服务号