首页>
外国专利>
DISTRIBUTED RANDOM FOREST TRAINING WITH A PREDICTOR TRAINED TO BALANCE TASKS
DISTRIBUTED RANDOM FOREST TRAINING WITH A PREDICTOR TRAINED TO BALANCE TASKS
展开▼
机译:分布式随机森林训练,带有预测员的平衡任务训练
展开▼
页面导航
摘要
著录项
相似文献
摘要
In one embodiment, a device distributes sets of training records from a training dataset for a random forest-based classifier among a plurality of workers of a computing cluster. Each worker determines whether it can perform a node split operation locally on the random forest by comparing a number of training records at the worker to a predefined threshold. The device determines, for each of the split operations, a data size and entropy measure of the training records to be used for the split operation. The device applies a machine learning-based predictor to the determined data size and entropy measure of the training records to be used for the split operation, to predict its completion time. The device coordinates the workers of the computing cluster to perform the node split operations in parallel such that the node split operations in a given batch are grouped based on their predicted completion times.
展开▼