TY - JOUR

T1 - Partial least-squares algorithm for weights initialization of backpropagation network

AU - Hsiao, Tzu Chien Ryan

AU - Lin, Chii Wann

AU - Chiang, Huihua Kenny

PY - 2003/1/1

Y1 - 2003/1/1

N2 - This paper proposes a hybrid scheme to set the weights initialization and the optimal number of hidden nodes of the backpropagation network (BPN) by applying the loading weights and factor numbers of the partial least-squares (PLS) algorithm. The joint PLS and BPN method (PLSBPN) starts with a small residual error, modifies the latent weight matrices, and obtains a near-global minimum in the calibration phase. Performances of the BPN, PLS, and PLSBPN were compared for the near infrared spectroscopic analysis of glucose concentrations in aqueous matrices. The results showed that the PLSBPN had the smallest root mean square error. The PLSBPN approach significantly solves some conventional problems of the BPN method by providing the good initial weights, reducing the calibration time, obtaining an optimal solution, and easily determining the number of hidden nodes.

AB - This paper proposes a hybrid scheme to set the weights initialization and the optimal number of hidden nodes of the backpropagation network (BPN) by applying the loading weights and factor numbers of the partial least-squares (PLS) algorithm. The joint PLS and BPN method (PLSBPN) starts with a small residual error, modifies the latent weight matrices, and obtains a near-global minimum in the calibration phase. Performances of the BPN, PLS, and PLSBPN were compared for the near infrared spectroscopic analysis of glucose concentrations in aqueous matrices. The results showed that the PLSBPN had the smallest root mean square error. The PLSBPN approach significantly solves some conventional problems of the BPN method by providing the good initial weights, reducing the calibration time, obtaining an optimal solution, and easily determining the number of hidden nodes.

KW - Backpropagation network

KW - Freedforward neural networks

KW - Partial least-squares

KW - Weights intialization

UR - http://www.scopus.com/inward/record.url?scp=0037241874&partnerID=8YFLogxK

U2 - 10.1016/S0925-2312(01)00708-1

DO - 10.1016/S0925-2312(01)00708-1

M3 - Article

AN - SCOPUS:0037241874

SN - 0925-2312

VL - 50

SP - 237

EP - 247

JO - Neurocomputing

JF - Neurocomputing

ER -