首页>
外国专利>
IMPLEMENTING PARAMETER SERVER IN NETWORKING INFRASTRUCTURE FOR HIGH-PERFORMANCE COMPUTING
IMPLEMENTING PARAMETER SERVER IN NETWORKING INFRASTRUCTURE FOR HIGH-PERFORMANCE COMPUTING
展开▼
机译：在网络基础架构中实现高性能计算的参数服务器
展开▼
页面导航
摘要
著录项
相似文献
摘要
Techniques are provided for implementing a parameter server within a networking infrastructure of a computing system to reduce the communication bandwidth and latency for performing communication synchronization operations of the parameter server. For example, a method includes executing a distributed deep learning (DL) model training process to train model parameters of a DL model using a plurality of worker nodes executing on one or more server nodes of a computing system, and executing a parameter server within a networking infrastructure of the computing system to aggregate local model parameters computed by the plurality of worker nodes and to distribute aggregated model parameters to the plurality of worker nodes using the networking infrastructure of the computing system.
展开▼
