Reinforcement Learning for Network Resilience

Principal Investigator: Vaneet Aggarwal

With the rapid growth of backbone networks and data center networks, ensuring network robustness and resilience has become a key challenge in network design. In this project, we use multi-agent reinforcement learning approaches for content placement, satisfying different peak and average constraint requirements in decision making. 

Representative Publications

• • Chang-Lin Chen, Hanhan Zhou, Jiayu Chen, Mohammad Pedramfar, Vaneet Aggarwal, Tian Lan, Zheqing Zhu, Chi Zhou, Tim Gasser, Pol Mauri Ruiz, Vijay Menon, Neeraj Kumar, and Hongbo Dong, "Two-tiered Online Optimization of Region-wide Datacenter Resource Allocation via Deep Reinforcement Learning," Jun 2023. 
  • Chenyi Liu, Vaneet Aggarwal, Tian Lan, Nan Geng, Yuan Yang, and Mingwei Xu, "Machine Learning for Robust Network Design: A New Perspective," Accepted to IEEE Communications Magazine, May 2023.
  • Chenyi Liu, Vaneet Aggarwal, Tian Lan, Nan Geng, Yuan Yang, Mingwei Xu, and Qing Li, "FERN: Leveraging Graph Attention Networks for Failure Evaluation and Robust Network Design," Accepted to IEEE/ACM Transactions on Networking, Aug 2023. 
  • Nan Geng, Qinbo Bai, Chenyi Liu, Tian Lan, Vaneet Aggarwal, Yuan Yang, and Mingwei Xu, "A Reinforcement Learning Framework for Vehicular Network Routing Under Peak and Average Constraints," IEEE Transactions on Vehicular Technology (TVT), vol. 72, no. 5, pp. 6753-6764, May 2023.
  • Chenyi Liu, Nan Geng, Vaneet Aggarwal, Tian Lan, Yuan Yang and Mingwei Xu, "CMIX: Deep Multi-agent Reinforcement Learning with Peak and Average Constraints" in Proc. ECML, Sep 2021
  • Nan Geng, Tian Lan, Vaneet Aggarwal, Yuan Yang, and Mingwei Xu, "A Multi-agent Reinforcement Learning Perspective on Distributed Traffic Engineering," in Proc. IEEE International Conference on Network Protocols (ICNP), Oct 2020.
  • Yimeng Wang, Yongbo Li, Tian Lan, and Vaneet Aggarwal, "DeepChunk: Deep Q-Learning for Chunk-based Caching in Data Processing Networks," IEEE Transactions on Cognitive Communications and Networking, Special Issue on Deep Reinforcement Learning for Future Wireless Communication Networks, vol. 5, no. 4, pp. 1034-1045, Dec. 2019.
  • Ramkumar Raghu, Pratheek Upadhyaya, Mahadesh Panju, Vaneet Aggarwal, and Vinod Sharma, "Deep Reinforcement Learning Based Power control for Wireless Multicast Systems," in Proc. Allerton, Oct 2019.
  • Yimeng Wang, Yongbo Li, Vaneet Aggarwal, and Tian Lan, "Deep Q-Learning for Chunk-based Caching in Data Processing Networks," in Proc. Allerton, Oct 2019.