TY - GEN
T1 - Model Pruning for Wireless Federated Learning with Heterogeneous Channels and Devices
AU - Wang, Da Wei
AU - Hsieh, Chi Kai
AU - Chan, Kun Lin
AU - Chien, Feng Tsun
N1 - Publisher Copyright:
© 2023 IEEE.
PY - 2023
Y1 - 2023
N2 - Federated learning (FL) enables distributed model training, ensuring user privacy and reducing communication overheads. Model pruning further improves learning efficiency by removing weight connections in neural networks, increasing inference speed and reducing model storage size. While a larger pruning ratio shortens latency in each communication round, a larger number of communication rounds is needed for convergence. In this work, a training-based pruning ratio decision policy is proposed for wireless federated learning. By jointly minimizing average gradients and training latency with a given specific time budget, we optimize the pruning ratio for each device and the total number of training rounds. Numerical results demonstrate that the proposed algorithm achieves a faster convergence rate and lower latency compared to the existing approach.
AB - Federated learning (FL) enables distributed model training, ensuring user privacy and reducing communication overheads. Model pruning further improves learning efficiency by removing weight connections in neural networks, increasing inference speed and reducing model storage size. While a larger pruning ratio shortens latency in each communication round, a larger number of communication rounds is needed for convergence. In this work, a training-based pruning ratio decision policy is proposed for wireless federated learning. By jointly minimizing average gradients and training latency with a given specific time budget, we optimize the pruning ratio for each device and the total number of training rounds. Numerical results demonstrate that the proposed algorithm achieves a faster convergence rate and lower latency compared to the existing approach.
UR - http://www.scopus.com/inward/record.url?scp=85172986834&partnerID=8YFLogxK
U2 - 10.1109/APWCS60142.2023.10234035
DO - 10.1109/APWCS60142.2023.10234035
M3 - Conference contribution
AN - SCOPUS:85172986834
T3 - Proceedings - 2023 VTS Asia Pacific Wireless Communications Symposium, APWCS 2023
BT - Proceedings - 2023 VTS Asia Pacific Wireless Communications Symposium, APWCS 2023
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2023 VTS Asia Pacific Wireless Communications Symposium, APWCS 2023
Y2 - 23 August 2023 through 25 August 2023
ER -