Hyperparameter Tuning of Machine Learning Algorithms Using Response Surface Methodology: A Case Study of ANN, SVM, and DBN

Warut Pannakkong; Kwanluck Thiwa-Anont; Kasidit SingthongParthana ParthanadeeJirachai BuddhakulsomsiriKuei-Hu Chang

首页> 外文期刊>Mathematical Problems in Engineering: Theory, Methods and Applications >Hyperparameter Tuning of Machine Learning Algorithms Using Response Surface Methodology: A Case Study of ANN, SVM, and DBN

【24h】

Hyperparameter Tuning of Machine Learning Algorithms Using Response Surface Methodology: A Case Study of ANN, SVM, and DBN

机译：Hyperparameter Tuning of Machine Learning Algorithms Using Response Surface Methodology: A Case Study of ANN, SVM, and DBN

获取原文

获取原文并翻译 | 示例

掌桥外文数据库（机构版） >>

开具论文收录证明 >>

文献代查 >>

页面导航

摘要
著录项
相关主题

摘要

This study applies response surface methodology (RSM) to the hyperparameter fine-tuning of three machine learning (ML) algorithms: artificial neural network (ANN), support vector machine (SVM), and deep belief network (DBN). The purpose is to demonstrate RSM effectiveness in maintaining ML algorithm performance while reducing the number of runs required to reach effective hyperparameter settings in comparison with the commonly used grid search (GS). The ML algorithms are applied to a case study dataset from a food producer in Thailand. The objective is to predict a raw material quality measured on a numerical scale. K-fold cross-validation is performed to ensure that the ML algorithm performance is robust to the data partitioning process in the training, validation, and testing sets. The mean absolute error (MAE) of the validation set is used as the prediction accuracy measurement. The reliability of the hyperparameter values from GS and RSM is evaluated using confirmation runs. Statistical analysis shows that (1) the prediction accuracy of the three ML algorithms tuned by GS and RSM is similar, (2) hyperparameter settings from GS are 80% reliable for ANN and DBN, and settings from RSM are 90% and 100% reliable for ANN and DBN, respectively, and (3) savings in the number of runs required by RSM over GS are 97.79%, 97.81%, and 80.69% for ANN, SVM, and DBN, respectively.

著录项

来源
《Mathematical Problems in Engineering: Theory, Methods and Applications》 |2022年第2期|1.1-1.17|共17页
作者
Warut Pannakkong; Kwanluck Thiwa-Anont; Kasidit SingthongParthana ParthanadeeJirachai BuddhakulsomsiriKuei-Hu Chang;
展开▼
作者单位

School of Manufacturing Systems and Mechanical Engineering Sirindhorn International Institute of Technology Thammasat University;

Department of Agro-Industrial Technology Faculty of Agro-Industry Kasetsart University;

展开▼
收录信息
原文格式 PDF
正文语种英语
中图分类
关键词

Hyperparameter Tuning of Machine Learning Algorithms Using Response Surface Methodology: A Case Study of ANN, SVM, and DBN

摘要

著录项

相关主题

期刊订阅