Multi-Agent AI Systems for Autonomous and Context-Aware Data Orchestration in Hybrid Cloud Platforms
DOI:
https://doi.org/10.59461/ijdiic.v5i1.260Keywords:
Context-aware , Data orchestration, Markov decision process, Workload balance, Decision makingAbstract
Hybrid cloud platforms face challenges in data orchestration due to dynamic resource allocation and workload changes. The framework uses multiple reinforcement learning agents equipped with context-awareness to autonomously manage data orchestration tasks. This investigation aims to develop an artificial intelligence (AI)-based data orchestration model using a Flexible Binary Spider Wasp Algorithm-enriched Double Deep Q-Network with Markov Decision Process (FBSWA-DDQN-MDP) to autonomously manage and optimize data placement, migration, and processing in hybrid cloud platforms. Data is collected from simulated hybrid cloud environments with varying workloads and resource availability. To ensure the dataset is prepared for modeling tasks, it has been preprocessed to eliminate missing values, normalize continuous features, and encode categorical variables. Principal Component Analysis (PCA) was used for feature extraction to improve computational efficiency. Using Python, simulations showed that the FBSWA-DDQN-MDP model outperformed traditional techniques with average energy consumption (AEC) (17.0 J), and average renting charge (ARC) (0.0006 cost) obtained at 1.8 Weight ω₂, normalized reward mean and standard deviation (SD) (0.97±0.01) values achieved at 1800 no of training episodes with adaptive response times under dynamic workloads. The proposed multi-agent AI system significantly improves data orchestration in hybrid cloud environments.
Downloads
References
S. Alberternst et al., “Orchestrating Heterogeneous Devices and AI Services as Virtual Sensors for Secure Cloud-Based IoT Applications,” Sensors, vol. 21, no. 22, p. 7509, Nov. 2021, https://doi.org/10.3390/s21227509.
P. Trakadas et al., “A Reference Architecture for Cloud–Edge Meta-Operating Systems Enabling Cross-Domain, Data-Intensive, ML-Assisted Applications: Architectural Overview and Key Concepts,” Sensors, vol. 22, no. 22, p. 9003, Nov. 2022, https://doi.org/10.3390/s22229003.
D. Calvaresi, Y. Dicente Cid, M. Marinoni, A. F. Dragoni, A. Najjar, and M. Schumacher, “Real-time multi-agent systems: rationality, formal model, and empirical results,” Autonomous Agents and Multi-Agent Systems, vol. 35, no. 1, p. 12, Apr. 2021, https://doi.org/10.1007/s10458-020-09492-5.
S. S. Binyamin and S. Ben Slama, “Multi-Agent Systems for Resource Allocation and Scheduling in a Smart Grid,” Sensors, vol. 22, no. 21, p. 8099, Oct. 2022, https://doi.org/10.3390/s22218099.
S. Darshan, “Multi-Agent Orchestration for Autonomous Data Pipelines: A Systems Architecture for Self-Healing, Context-Aware, and Resilient Data Processing,” International Journal of Emerging Research in Engineering and Technology, vol. 7, no. 1, pp. 47–53, 2026, https://doi.org/10.63282/3050-922X.IJERET-V7I1P107.
H. Chen, “Intelligent Agent-Based Market Research: Cloud-Orchestrated Large Language Models as Financial Analysts,” Cloud Computing and Data Science, pp. 161–168, Jan. 2026, https://doi.org/10.37256/ccds.7120269128.
R. C. Sofia, D. Dykeman, P. Urbanetz, A. Galal, and D. A. Dave, “Dynamic, Context-Aware Cross-Layer Orchestration of Containerized Applications,” IEEE Access, vol. 11, pp. 93129–93150, 2023, https://doi.org/10.1109/ACCESS.2023.3307026.
S. Shahzadi, N. R. Chaudhry, and M. Iqbal, “A Novel 6G Conversational Orchestration Framework for Enhancing Performance and Resource Utilization in Autonomous Vehicle Networks,” Sensors, vol. 23, no. 17, p. 7366, Aug. 2023, https://doi.org/10.3390/s23177366.
F. F. Salerno and A. C. G. Maçada, “Data orchestration as an emerging phenomenon: a systematic literature review on its intersections with data governance and data strategy,” Management Review Quarterly, Oct. 2025, https://doi.org/10.1007/s11301-025-00558-w.
M. Weber, A. Hein, J. Weking, and H. Krcmar, “Orchestration logics for artificial intelligence platforms: From raw data to industry‐specific applications,” Information Systems Journal, vol. 35, no. 3, pp. 1015–1043, May 2025, https://doi.org/10.1111/isj.12567.
S. Banaeian Far and A. Imani Rad, “Internet of Artificial Intelligence (IoAI): the emergence of an autonomous, generative, and fully human-disconnected community,” Discover Applied Sciences, vol. 6, no. 3, p. 91, Feb. 2024, https://doi.org/10.1007/s42452-024-05726-3.
M. Shahin et al., “DatApollo: Orchestration of Serverless Functions for Scalable Data Mining,” IEEE Access, vol. 13, pp. 142813–142828, 2025, https://doi.org/10.1109/ACCESS.2025.3591712.
M. Groshev, L. Zanzi, C. Delgado, X. Li, A. de la Oliva, and X. Costa-Pérez, “Energy-Aware Joint Orchestration of 5G and Robots: Experimental Testbed and Field Validation,” IEEE Transactions on Network and Service Management, vol. 22, no. 4, pp. 3046–3059, Aug. 2025, https://doi.org/10.1109/TNSM.2025.3555126.
S. Limkar, M. A. Hossain, S. T. Amin, and Y. Ahmad, “Dynamic Resource Orchestration for Computing, Data, and IoT in Networked Systems: A Data‐Centric Approach,” in Current and Future Cellular Systems, Wiley, 2025, pp. 185–207, https://doi.org/10.1002/9781394256075.ch10
I. Ficili, M. Giacobbe, G. Tricomi, and A. Puliafito, “From Sensors to Data Intelligence: Leveraging IoT, Cloud, and Edge Computing with AI,” Sensors, vol. 25, no. 6, p. 1763, Mar. 2025, https://doi.org/10.3390/s25061763.
A. Sezgin, “Scenario-Driven Evaluation of Autonomous Agents: Integrating Large Language Model for UAV Mission Reliability,” Drones, vol. 9, no. 3, p. 213, Mar. 2025, https://doi.org/10.3390/drones9030213.
J. Chen, P. Chen, X. Niu, Z. Wu, L. Xiong, and C. Shi, “Task offloading in hybrid-decision-based multi-cloud computing network: a cooperative multi-agent deep reinforcement learning,” Journal of Cloud Computing, vol. 11, no. 1, p. 90, Dec. 2022, https://doi.org/10.1186/s13677-022-00372-9.
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Aditya Gupta, Sai Kiran Oruganti
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
