Asynchronous Federated Learning with Grey Wolf Optimization for the Heterogeneity IoT Devices
DOI:
https://doi.org/10.59461/ijdiic.v3i2.105Keywords:
Machine Learning , Heterogeneity IoT devices, Light-weight node selection , Federated LearningAbstract
The Internet of Things (IoT) creates new options for real-time data collection and Machine Learning (ML) model development. Nonetheless, it's feasible that a particular IoT device does not have sufficient computational power to train and implement a complete learning model. However, there are significant communication costs and data security and privacy concerns associated with sending actual data to a centralised server with a lot of computational power. Federated Learning (FL) is a potential way to train ML models using low-powered devices and Edge Servers (ES) since it is a distributed ML architecture. However, the vast majority of the works in existence make the unsustainable assumption of a synchronized parameters update manner with similar IoT nodes and reliable communications networks. To increase training efficiency and accelerate the speed for heterogeneous IoT devices in an unreliable network environment, we designed an Asynchronous Federated Learning strategy with Grey Wolf Optimization (AFL-GWO) in this research. In particular, we develop a Lightweight Node Selection (LNS) technique and propose an AFL-GWO model to efficiently complete learning tasks. To ensure that diverse IoT nodes with varying computational capabilities and network connectivity are represented in the global learning aggregate, the proposed technique makes node selections on an iterative basis. We show through extensive experiments that our suggested AFL-GWO system outperforms the state-of-the-art techniques on identically and independently distributed (IID) and non-IID data distribution in a variety of contexts.
Downloads
References
H. Wang, M. Daneshmand, and H. Fang, “Artificial Intelligence (AI) Driven Wireless Body Area Networks: Challenges and Directions,” in 2019 IEEE International Conference on Industrial Internet (ICII), IEEE, Nov. 2019, pp. 428–429. doi: 10.1109/ICII.2019.00079.
D. Wu, H. Shi, H. Wang, R. Wang, and H. Fang, “A Feature-Based Learning System for Internet of Things Applications,” IEEE Internet Things J., vol. 6, no. 2, pp. 1928–1937, Apr. 2019, doi: 10.1109/JIOT.2018.2884485.
F. Liang, W. G. Hatcher, W. Liao, W. Gao, and W. Yu, “Machine Learning for Security and the Internet of Things: The Good, the Bad, and the Ugly,” IEEE Access, vol. 7, pp. 158126–158147, 2019, doi: 10.1109/ACCESS.2019.2948912.
H. Hu, D. Wang, and C. Wu, “Distributed Machine Learning through Heterogeneous Edge Systems,” Proc. AAAI Conf. Artif. Intell., vol. 34, no. 05, pp. 7179–7186, Apr. 2020, doi: 10.1609/aaai.v34i05.6207.
J. Lin, W. Yu, N. Zhang, X. Yang, H. Zhang, and W. Zhao, “A Survey on Internet of Things: Architecture, Enabling Technologies, Security and Privacy, and Applications,” IEEE Internet Things J., vol. 4, no. 5, pp. 1125–1142, Oct. 2017, doi: 10.1109/JIOT.2017.2683200.
F. Liang, W. Yu, X. Liu, D. Griffith, and N. Golmie, “Toward Edge-Based Deep Learning in Industrial Internet of Things,” IEEE Internet Things J., vol. 7, no. 5, pp. 4329–4341, May 2020, doi: 10.1109/JIOT.2019.2963635.
T. Li, A. K. Sahu, A. Talwalkar, and V. Smith, “Federated Learning: Challenges, Methods, and Future Directions,” IEEE Signal Process. Mag., vol. 37, no. 3, pp. 50–60, May 2020, doi: 10.1109/MSP.2020.2975749.
H. Xu, X. Liu, W. Yu, D. Griffith, and N. Golmie, “Reinforcement Learning-Based Control and Networking Co-Design for Industrial Internet of Things,” IEEE J. Sel. Areas Commun., vol. 38, no. 5, pp. 885–898, May 2020, doi: 10.1109/JSAC.2020.2980909.
M. Li, Y. Sun, H. Lu, S. Maharjan, and Z. Tian, “Deep Reinforcement Learning for Partially Observable Data Poisoning Attack in Crowdsensing Systems,” IEEE Internet Things J., vol. 7, no. 7, pp. 6266–6278, Jul. 2020, doi: 10.1109/JIOT.2019.2962914.
L. Tseng, L. Wong, S. Otoum, M. Aloqaily, and J. Ben Othman, “Blockchain for Managing Heterogeneous Internet of Things: A Perspective Architecture,” IEEE Netw., vol. 34, no. 1, pp. 16–23, Jan. 2020, doi: 10.1109/MNET.001.1900103.
L. Lan, R. Shi, B. Wang, and L. Zhang, “An IoT Unified Access Platform for Heterogeneity Sensing Devices Based on Edge Computing,” IEEE Access, vol. 7, pp. 44199–44211, 2019, doi: 10.1109/ACCESS.2019.2908684.
Y. Cui, K. Cao, G. Cao, M. Qiu, and T. Wei, “Client Scheduling and Resource Management for Efficient Training in Heterogeneous IoT-Edge Federated Learning,” IEEE Trans. Comput. Des. Integr. Circuits Syst., vol. 41, no. 8, pp. 2407–2420, Aug. 2022, doi: 10.1109/TCAD.2021.3110743.
N. Kherraf, H. A. Alameddine, S. Sharafeddine, C. M. Assi, and A. Ghrayeb, “Optimized Provisioning of Edge Computing Resources With Heterogeneous Workload in IoT Networks,” IEEE Trans. Netw. Serv. Manag., vol. 16, no. 2, pp. 459–474, Jun. 2019, doi: 10.1109/TNSM.2019.2894955.
S. K. Roy, S. Misra, and N. S. Raghuwanshi, “SensPnP: Seamless Integration of Heterogeneous Sensors With IoT Devices,” IEEE Trans. Consum. Electron., vol. 65, no. 2, pp. 205–214, May 2019, doi: 10.1109/TCE.2019.2903351.
Y. Chen, M. Li, P. Chen, and S. Xia, “Survey of cross‐technology communication for IoT heterogeneous devices,” IET Commun., vol. 13, no. 12, pp. 1709–1720, Jul. 2019, doi: 10.1049/iet-com.2018.6069.
R. Kumar and R. Sharma, “Leveraging blockchain for ensuring trust in IoT: A survey,” J. King Saud Univ. - Comput. Inf. Sci., vol. 34, no. 10, pp. 8599–8622, Nov. 2022, doi: 10.1016/j.jksuci.2021.09.004.
Y. Liu, K. Wang, K. Qian, M. Du, and S. Guo, “Tornado: Enabling Blockchain in Heterogeneous Internet of Things Through a Space-Structured Approach,” IEEE Internet Things J., vol. 7, no. 2, pp. 1273–1286, Feb. 2020, doi: 10.1109/JIOT.2019.2954128.
H. Yang et al., “FedRich: Towards efficient federated learning for heterogeneous clients using heuristic scheduling,” Inf. Sci. (Ny)., vol. 645, p. 119360, Oct. 2023, doi: 10.1016/j.ins.2023.119360.
M. A. Khan and K. A. Abuhasel, “Advanced metameric dimension framework for heterogeneous industrial Internet of things,” Comput. Intell., vol. 37, no. 3, pp. 1367–1387, Aug. 2021, doi: 10.1111/coin.12378.
Y. Mesmoudi, M. Lamnaour, Y. El Khamlichi, A. Tahiri, A. Touhafi, and A. Braeken, “A Middleware based on Service Oriented Architecture for Heterogeneity Issues within the Internet of Things (MSOAH-IoT),” J. King Saud Univ. - Comput. Inf. Sci., vol. 32, no. 10, pp. 1108–1116, Dec. 2020, doi: 10.1016/j.jksuci.2018.11.011.
S. Wang et al., “When Edge Meets Learning: Adaptive Control for Resource-Constrained Distributed Machine Learning,” in IEEE INFOCOM 2018 - IEEE Conference on Computer Communications, IEEE, Apr. 2018, pp. 63–71. doi: 10.1109/INFOCOM.2018.8486403.
H. B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. A. y Arcas, “Communication-Efficient Learning of Deep Networks from Decentralized Data,” Feb. 2016, [Online]. Available: http://arxiv.org/abs/1602.05629
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Bambang Hari Kusumo, Prabhdeep Singh
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
