Asynchronous federated and reinforcement learning for mobility-aware edge caching in IoVs

Kai Jiang, Yue Cao, Yujie Song, Huan Zhou, Shaohua Wan, Xu Zhang

Research output: Contribution to journalArticlepeer-review

2 Citations (Scopus)
5 Downloads (Pure)

Abstract

Edge caching is a promising technology to reduce backhaul strain and content access delay in Internet-of-Vehicles (IoVs). It pre-caches frequently-used contents close to vehicles through intermediate roadside units. Previous edge caching works often assume that content popularity is known in advance or obeys simplified models. However, such assumptions are unrealistic, as content popularity varies with uncertain spatial-temporal traffic demands in IoVs. Federated learning (FL) enables vehicles to predict popular content with distributed training. It preserves the training data remain local, thereby addressing privacy concerns and communication resource shortages. This paper investigates a mobility-aware edge caching strategy by exploiting asynchronous FL and Deep Reinforcement Learning (DRL). We first implement a novel asynchronous FL framework for local updates and global aggregation of Stacked AutoEncoder (SAE) models. Then, utilizing the latent features extracted by the trained SAE model, we adopt a hybrid filtering model for predicting and recommending popular content. Furthermore, we explore intelligent caching decisions after content prediction. Based on the formulated Markov Decision Process (MDP) problem, we propose a DRL-based solution, and adopt neural network-based parameter approximations for the curse of dimensionality in RL. Extensive simulations are conducted based on real-world data trajectory. Especially, our proposed method outperforms FedAvg, LRU, and NoDRL, and the edge hit rate is improved by roughly 6%, 21%, and 15%, respectively, when the cache capacity reaches 350 MB.

Original languageEnglish
Pages (from-to)15334-15347
Number of pages14
JournalIEEE Internet of Things Journal
Volume11
Issue number9
Early online date2 Jan 2024
DOIs
Publication statusPublished - 1 May 2024
Externally publishedYes

Keywords

  • Computational modeling
  • content prediction
  • Data models
  • deep reinforcement learning
  • Delays
  • Edge caching
  • Feature extraction
  • federated learning
  • Optimization
  • Predictive models
  • stacked autoencoder
  • Training
  • edge caching
  • stacked autoencoder (SAE)
  • deep reinforcement learning (DRL)
  • federated learning (FL)
  • Content prediction

Cite this