A Reinforcement Learning based approach for Multi-target Detection in Massive MIMO radar - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Aerospace and Electronic Systems Année : 2021

A Reinforcement Learning based approach for Multi-target Detection in Massive MIMO radar

Résumé

This paper considers the problem of multi-target detection for massive multiple input multiple output (MMIMO) cognitive radar (CR). The concept of CR is based on the perception-action cycle that senses and intelligently adapts to the dynamic environment in order to optimally satisfy a specific mission. However, this usually requires a priori knowledge of the environmental model, which is not available in most cases. We propose a reinforcement learning (RL) based algorithm for cognitive multi-target detection in the presence of unknown disturbance statistics. The radar acts as an agent that continuously senses the unknown environment (i.e., targets and disturbance) and consequently optimizes transmitted waveforms in order to maximize the probability of detection (P D) by focusing the energy in specific range-angle cells (i.e., beamforming). Furthermore, we propose a solution to the beamforming optimization problem with less complexity than the existing methods. Numerical simulations are performed to assess the performance of the proposed RL-based algorithm in both stationary and dynamic environments. The RL based beamforming is compared to the conventional omnidirectional approach with equal power allocation and to adaptive beamforming with no RL. As highlighted by the proposed numerical results, our RL-based beamformer outperforms both approaches in terms of target detection performance. The performance improvement is even particularly remarkable under environmentally harsh conditions such as low SNR, heavy-tailed disturbance and rapidly changing scenarios.
Fichier principal
Vignette du fichier
Paper_TAES_HAL.pdf (2.02 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03158899 , version 1 (04-03-2021)

Identifiants

Citer

Aya Mostafa Ahmed, Alaa Alameer Ahmad, Stefano Fortunati, Aydin Sezgin, Maria Greco, et al.. A Reinforcement Learning based approach for Multi-target Detection in Massive MIMO radar. IEEE Transactions on Aerospace and Electronic Systems, 2021, pp.1-1. ⟨10.1109/TAES.2021.3061809⟩. ⟨hal-03158899⟩
130 Consultations
478 Téléchargements

Altmetric

Partager

Gmail Mastodon Facebook X LinkedIn More