TY - GEN
T1 - Fine-Tuned Based Transfer Learning with Temporal Attention and Physics-Informed Loss for Bearing RUL Prediction
AU - Mp, Pavan Kumar
AU - Tu, Zhe Xiang
AU - Chen, Kun Chih Jimmy
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - In the realm of industrial applications, ensuring the reliability of rotating machinery components, specifically bearings, is crucial to prevent unexpected downtime. Despite the benefits of integrating Deep Learning (DL) into Prognostics and Health Management (PHM) for improved Remaining Useful Life (RUL) prediction, challenges persist due to limited labeled data and generalizability issues. Transfer Learning (TL) offers a solution, yet fine-tuning with scarce target domain data poses a risk of Negative Transfer Learning (NTL). To mitigate this, we introduce a Temporal Attention Mechanism (TAM), dynamically weighing the importance of temporal channels and capturing local and global temporal dependencies. This ensures optimal focus on relevant temporal features during fine-tuning. Additionally, the conventional reliance on historical patterns in data loss functions for predicting degradation patterns introduces interpretability limitations. Thus, we propose a novel physics-informed loss function incorporating mechanical degradation factors, offering a comprehensive approach to accurate RUL predictions. Experimental results showcase the efficacy of TAM, achieving an average percentage reduction of approximately 50.93% to 90.67% in Mean Absolute Percentage Error (MAPE) compared to related works. The proposed Physics-Informed approach consistently outperforms traditional Mean Squared Error (MSE), demonstrating robustness and superior adaptability in diverse operating conditions.
AB - In the realm of industrial applications, ensuring the reliability of rotating machinery components, specifically bearings, is crucial to prevent unexpected downtime. Despite the benefits of integrating Deep Learning (DL) into Prognostics and Health Management (PHM) for improved Remaining Useful Life (RUL) prediction, challenges persist due to limited labeled data and generalizability issues. Transfer Learning (TL) offers a solution, yet fine-tuning with scarce target domain data poses a risk of Negative Transfer Learning (NTL). To mitigate this, we introduce a Temporal Attention Mechanism (TAM), dynamically weighing the importance of temporal channels and capturing local and global temporal dependencies. This ensures optimal focus on relevant temporal features during fine-tuning. Additionally, the conventional reliance on historical patterns in data loss functions for predicting degradation patterns introduces interpretability limitations. Thus, we propose a novel physics-informed loss function incorporating mechanical degradation factors, offering a comprehensive approach to accurate RUL predictions. Experimental results showcase the efficacy of TAM, achieving an average percentage reduction of approximately 50.93% to 90.67% in Mean Absolute Percentage Error (MAPE) compared to related works. The proposed Physics-Informed approach consistently outperforms traditional Mean Squared Error (MSE), demonstrating robustness and superior adaptability in diverse operating conditions.
KW - Bearing RUL prediction
KW - Fine Tuning
KW - Transfer Learning
KW - physics-informed loss function
UR - http://www.scopus.com/inward/record.url?scp=85199857359&partnerID=8YFLogxK
U2 - 10.1109/AICAS59952.2024.10595914
DO - 10.1109/AICAS59952.2024.10595914
M3 - Conference contribution
AN - SCOPUS:85199857359
T3 - 2024 IEEE 6th International Conference on AI Circuits and Systems, AICAS 2024 - Proceedings
SP - 282
EP - 286
BT - 2024 IEEE 6th International Conference on AI Circuits and Systems, AICAS 2024 - Proceedings
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 6th IEEE International Conference on AI Circuits and Systems, AICAS 2024
Y2 - 22 April 2024 through 25 April 2024
ER -