ACE-Sync: An Adaptive Cloud-Edge Synchronization Framework for Large-Scale Distributed Training

Authors

  • Noah Romano Paul G. Allen School of Computer Science and Engineering, University of Washington, Seattle, WA, USA Author
  • Eleanor Higgins Paul G. Allen School of Computer Science and Engineering, University of Washington, Seattle, WA, USA Author
  • Noah Keller Paul G. Allen School of Computer Science and Engineering, University of Washington, Seattle, WA, USA Author
  • Julian Vance Paul G. Allen School of Computer Science and Engineering, University of Washington, Seattle, WA, USA Author

DOI:

https://doi.org/10.66525/ijictt84

Keywords:

Distributed Training, Edge Computing, Gradient Synchronization, Cloud-Edge Collaboration

Abstract

The proliferation of data generated at the network edge has driven the need for decentralized machine learning approaches, specifically large-scale distributed training across the cloud-edge continuum. However, synchronizing deep neural network models between resource-rich cloud servers and resource-constrained edge devices presents significant challenges, primarily due to variable network bandwidth, high latency, and node heterogeneity. This paper introduces an adaptive cloud-edge synchronization framework designed to optimize the communication efficiency and convergence stability of distributed training. The proposed framework dynamically adjusts the synchronization frequency and applies context-aware gradient compression based on real-time network conditions and local training progress. By decoupling the synchronization cycles from strict global epochs, the architecture mitigates the straggler effect common in heterogeneous environments. Comprehensive evaluations demonstrate that the proposed framework significantly reduces communication overhead while maintaining model accuracy comparable to traditional centralized approaches. The adaptive nature of the synchronization protocols ensures robust performance even under severe network degradation. This research provides a scalable solution for deploying complex deep learning models across distributed edge networks, facilitating the next generation of intelligent, privacy-preserving, and bandwidth-efficient applications.

Downloads

Download data is not yet available.

References

Dean, J., & Ghemawat, S. (2004). MapReduce: Simplified data processing on large clusters. In Proceedings of OSDI.

Xu, H., Lei, Y., Chen, Z., Zhang, X., Zhao, Y., Wang, Y., & Tu, Z. (2024). Bayesian diffusion models for 3d shape reconstruction. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (pp. 10628-10638).

Ma, F., Liu, L., & Cheng, H. V. (2024). TIMA: Text-Image Mutual Awareness for Balancing Zero-Shot Adversarial Robustness and Generalization Ability. arXiv preprint arXiv:2405.17678.

Huang, Y., Zhang, C., & Pan, C. (2022). Spectrum Sensing for DTMB-A System Using Accumulated Autocorrelation. IEEE Access, 10, 113610-113618.

Zhou Z, Leng N, Ma H, et al. Study on Real-Time Data Analysis and Intelligent Forecasting Methods for Integrated Circuit Supply Chains Based on Cloud Computing[C]//Proceedings of the 2nd International Symposium on Integrated Circuit Design and Integrated Systems. 2025: 245-250.

Chen, M., Chen, R., Zhao, Y., Yang, Z., & Guan, Y. L. (2023). Index-modulation OAM detectors resistant to beam misalignment. IEEE Transactions on Vehicular Technology, 73(2), 2836-2841.

He, Z., Qu, Y., Chen, G., Raj, R. S., Lin, H., & Jin, D. (2024, April). Towards secure and resilient synchrophasor networks using p4 programmable switches. In 2024 IEEE Green Technologies Conference (GreenTech) (pp. 17-21). IEEE.

Fan, D., Feng, Q., Zhang, A., Liu, M., Ren, Y., & Wang, Y. (2023). Optimization of scheduling and timetabling for multiple electric bus lines considering nonlinear energy consumption model. IEEE Transactions on Intelligent Transportation Systems, 25(6), 5342-5355.

Wu, J., Sun, Y., Xie, T., Chen, S., Bao, J., Xu, Y., ... & Wang, X. (2026). Cross-Modal Memory Compression for Efficient Multi-Agent Debate. arXiv preprint arXiv:2602.00454.

CHEN, R., GUb, B., & YEc, Z. (2025). Design and implementation of big data-driven business intelligence analytics system.

Tang, Y., Kojima, K., Gotoda, M., Nishikawa, S., Hayashi, S., Koike-Akino, T., ... & Klamkin, J. (2020, February). InP grating coupler design for vertical coupling of InP and silicon chips. In Integrated Optics: Devices, Materials, and Technologies XXIV (Vol. 11283, pp. 33-38). SPIE.

Huang, Y., Chen, G., Badiu, M. A., & Coon, J. (2025, June). ISAC-Enabled Channel-Aware Beam Management in THz Networks with Sensing Errors. In 2025 IEEE International Conference on Communications Workshops (ICC Workshops) (pp. 1389-1394). IEEE.

He, Z., Qu, Y., & Jin, D. (2025, June). Real-Time Power System Event Detection on Programmable Network Switches with Synchrophasor Data. In ICC 2025-IEEE International Conference on Communications (pp. 3918-3923). IEEE.

Huang, Y., Xu, J., Badiu, M. A., Chen, G., Coon, J., & Alouini, M. S. (2026). ISAC-Enabled Low-Overhead Beam Management: Performance Analysis and Pilot Optimization. IEEE Transactions on Wireless Communications.

Ren, Y., Gay, G., Kästner, C., & Jamshidi, P. (2020). Understanding the nature of system-related issues in machine learning frameworks: An exploratory study. arXiv preprint arXiv:2005.06091.

Ho, S. M., Liu, Y., Hussain, G. M., Gori, G., Kaur, R., & Gills, K. C. (2025). Synthetic Lies, Digital Truths: A Systematic Review of Computer-Mediated Deception Research in the Era of AI and Deepfakes.

Burrows, M. (2006). The Chubby lock service for loosely-coupled distributed systems. In Proceedings of OSDI.

Sigelman, B. H., Barroso, L. A., Burrows, M., Stephenson, P., Plakal, M., Beaver, D., et al. (2010). Dapper, a large-scale distributed systems tracing infrastructure. Technical Report, Google.

Zaharia, M., Chowdhury, M., Franklin, M. J., Shenker, S., & Stoica, I. (2012). Resilient distributed datasets: A fault-tolerant abstraction for in-memory cluster computing. In Proceedings of NSDI.

Xu, Y., Sakata, I., & Ishikawa, I. (2025). Data-Driven Spectral Analysis Through Pseudo-Resolvent Koopman Operator in Dynamical Systems. arXiv preprint arXiv:2512.24953.

Wang, Y., Li, L., Tang, Y., Zhang, R., & Liu, J. (2025). Toward copyright integrity and verifiability via multi-bit watermarking for intelligent transportation systems. IEEE Transactions on Intelligent Transportation Systems.

Yang, C., Wang, Z., Oh, S. K., Pedrycz, W., & Yang, B. (2022). Ensemble fuzzy radial basis function neural networks architecture driven with the aid of multi-optimization through clustering techniques and polynomial-based learning. Fuzzy sets and systems, 438, 62-83.

Bao, Z., Zhu, D., Jiang, L., Sheng, S., Wang, Z., & Zhang, H. (2025). SLOFetch: Compressed-Hierarchical Instruction Prefetching for Cloud Microservices. arXiv preprint arXiv:2511.04774.

Zhang, Y., Liu, J., Wang, J., Dai, L., Guo, F., & Cai, G. (2025, February). Federated learning for cross-domain data privacy: A distributed approach to secure collaboration. In 2025 8th International Symposium on Big Data and Applied Statistics (ISBDAS) (pp. 824-828). IEEE.

Norris, J., He, Z., Qu, Y., Chen, G., Hertzog, C., & Jin, D. (2025, September). An in-network approach for pmu missing data recovery with data plane programmability. In 2025 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm) (pp. 1-7). IEEE.

Cao, R., Wang, Y., Zhao, L., Wang, Z., & Mei, N. (2025). Artificial Intelligence Attack-Resilient Physical Unclonable Functions from Colloidal Nanowire Randomness. ACS Applied Materials & Interfaces, 18(1), 2491-2500.

Yang, Y., Lin, Z., & Wei, L. (2025). ACE-Sync: An Adaptive Cloud-Edge Synchronization Framework for Communication-Efficient Large-Scale Distributed Model Training. arXiv preprint arXiv:2512.18127.

Ahmad, N. R. (2025). Exploring the role of digital technologies in enhancing supply chain efficiency: A case study of e-commerce companies. Indus Journal of Social Sciences, 3(1), 226–237. https://doi.org/10.59075/ijss.v3i1.618

Downloads

Published

2026-04-05