Efficient Resource Management for Edge Computing Systems Using Reinforcement Learning Techniques

Authors

  • Rahul L. Chatterjee Department of Computer Science, University of New Hampshire, Durham, NH, USA. Author
  • Sawyer Salonen Department of Electrical Engineering and Computer Science, University of Kansas, Lawrence, KS, USA. Author
  • Manish L. Jha School of Computing, Clemson University, Clemson, SC, USA. Author

Keywords:

edge computing, reinforcement learning, resource management, orchestration, distributed systems, governance, fairness, sustainability

Abstract

Edge computing has emerged as a foundational paradigm for latency-sensitive, bandwidth-intensive, and data-sovereignty-conscious applications by moving computation closer to users, devices, and data sources. However, edge infrastructures are characterized by high resource heterogeneity, constrained energy budgets, dynamic workload arrival, multi-tenant competition, and fragmented administrative control. These conditions make static resource management heuristics and conventional optimization approaches increasingly inadequate. Reinforcement learning offers a promising alternative by enabling systems to learn adaptive sequential decision policies from operational experience without requiring complete models of workload behavior or infrastructure dynamics. This paper provides a system-level examination of reinforcement learning for resource management in edge computing environments. It analyzes architectural integration, structural trade-offs, governance requirements, deployment constraints, robustness, fairness, and sustainability. The discussion extends beyond algorithmic performance to consider how learning-based controllers interact with existing orchestration layers, telemetry systems, security boundaries, and policy frameworks. It argues that successful deployment depends on treating reinforcement learning as part of a larger socio-technical infrastructure rather than as an isolated optimization component. The paper draws on cross-domain illustrations from vehicular networks, content delivery, cloud scheduling, and collective resource governance to identify forward-looking research directions and policy implications for adaptive edge systems.

References

1. Shi, W., Cao, J., Zhang, Q., Li, Y., & Xu, L. (2016). Edge computing: Vision and challenges. IEEE Internet of Things Journal, 3(5), 637–646. https://doi.org/10.1109/JIOT.2016.2579198

2. Sutton, R. S., & Barto, A. G. (2018). Reinforcement learning: An introduction (2nd ed.). MIT Press.

3. Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., Petersen, S., Beattie, C., Sadik, A., Antonoglou, I., King, H., Kumaran, D., Wierstra, D., Legg, S., & Hassabis, D. (2015). Human-level control through deep reinforcement learning. Nature, 518(7540), 529–533. https://doi.org/10.1038/nature14236

4. Mao, H., Netravali, R., & Alizadeh, M. (2017). Neural adaptive video streaming with Pensieve. Proceedings of the Conference of the ACM Special Interest Group on Data Communication, 197–210. https://doi.org/10.1145/3098822.3098843

5. Mao, H., Alizadeh, M., Menache, I., & Kandula, S. (2016). Resource management with deep reinforcement learning. Proceedings of the 15th ACM Workshop on Hot Topics in Networks, 50–56. https://doi.org/10.1145/3005745.3005750

6. Satyanarayanan, M. (2017). The emergence of edge computing. Computer, 50(1), 30–39. https://doi.org/10.1109/MC.2017.9

7. Hu, W., Gao, Y., Ha, K., Wang, J., Amos, B., Chen, Z., Pillai, P., & Satyanarayanan, M. (2016). Quantifying the impact of edge computing on mobile applications. Proceedings of the 7th ACM SIGOPS Asia-Pacific Workshop on Systems, 1–8. https://doi.org/10.1145/2967360.2967369

8. Wang, S., Zhang, X., Zhang, Y., Wang, L., Yang, J., & Wang, W. (2017). A survey on mobile edge networks: Convergence of computing, caching and communications. IEEE Access, 5, 6757–6779. https://doi.org/10.1109/ACCESS.2017.2685434

9. Chen, X., Jiao, L., Li, W., & Fu, X. (2016). Efficient multi-user computation offloading for mobile-edge cloud computing. IEEE/ACM Transactions on Networking, 24(5), 2795–2808. https://doi.org/10.1109/TNET.2015.2487344

10. Xu, J., Chen, L., & Zhou, P. (2018). Joint service caching and task offloading for mobile edge computing in dense networks. IEEE INFOCOM 2018 - IEEE Conference on Computer Communications, 207–215. https://doi.org/10.1109/INFOCOM.2018.8485977

11. Liang, L., Ye, H., & Li, G. Y. (2019). Spectrum sharing in vehicular networks based on multi-agent reinforcement learning. IEEE Journal on Selected Areas in Communications, 37(10), 2282–2292. https://doi.org/10.1109/JSAC.2019.2933962

12. Ostrom, E. (1990). Governing the commons: The evolution of institutions for collective action. Cambridge University Press.

13. Barocas, S., Hardt, M., & Narayanan, A. (2019). Fairness and machine learning. fairmlbook.org. http://www.fairmlbook.org

14. Strubell, E., Ganesh, A., & McCallum, A. (2019). Energy and policy considerations for deep learning in NLP. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, 3645–3650. https://doi.org/10.18653/v1/P19-1355

15. Henderson, P., Islam, R., Bachman, P., Pineau, J., Precup, D., & Meger, D. (2018). Deep reinforcement learning that matters. Proceedings of the AAAI Conference on Artificial Intelligence, 32(1), 3207–3214. https://doi.org/10.1609/aaai.v32i1.11694

16. Dulac-Arnold, G., Mankowitz, D., & Hester, T. (2019). Challenges of real-world reinforcement learning. arXiv preprint arXiv:1904.12901. https://arxiv.org/abs/1904.12901

17. Wang, X., Han, Y., Leung, V. C. M., Niyato, D., Chen, X., & Han, Z. (2020). Convergence of edge computing and deep learning: A comprehensive survey. IEEE Communications Surveys & Tutorials, 22(2), 869–904. https://doi.org/10.1109/COMST.2020.2970550

18. Morley, J., Floridi, L., Kinsey, L., & Elhalal, A. (2020). From what to how: An initial review of publicly available AI ethics tools, methods and research to translate principles into practices. Science and Engineering Ethics, 26(4), 2141–2168. https://doi.org/10.1007/s11948-019-00165-5

19. Doshi-Velez, F., & Kim, B. (2017). Towards a rigorous science of interpretable machine learning. arXiv preprint arXiv:1702.08608. https://arxiv.org/abs/1702.08608

20. Nowak, M. A. (2006). Five rules for the evolution of cooperation. Science, 314(5805), 1560–1563. https://doi.org/10.1126/science.1133755

21. Varghese, B., Wang, N., Barbhuiya, S., Kilpatrick, P., & Nikolopoulos, D. S. (2016). Challenges and opportunities in edge computing. Proceedings of the IEEE International Conference on Smart Cloud, 20–26. https://doi.org/10.1109/SmartCloud.2016.18

Downloads

Published

2026-06-20