Aerodynamics-Based Collision-Free Control of Connected Drones in Complex Urban Low-Altitude Airspace Using Distributional Reinforcement Learning

Bing Hao Liao, Chao Yang Lee, Li Chun Wang*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Recent growth in the number of drones has made traffic management unworkable, particularly in urban areas. The safe operation and optimized navigation of drone swarms are now growing concerns. In this article, we use distributional reinforcement learning to prevent drone collisions via aerodynamic acceleration and deceleration. Although the instantaneous acceleration or deceleration of drones during an encounter influences drone kinematics, we note that drone kinematics itself can prevent collisions via instantaneous acceleration or deceleration. This article's central question, then, is how to take drone kinematics into account to improve air traffic intersection flow performance. First, the intercommunication between drone swarms is established via an Internet of drones to send and receive the current state of each drone in the swarm and detect potential collisions. In the presence of obstacles, we first use distributional reinforcement learning to find the inevitable change in kinematic height and guide descents and ascents through air traffic intersections. Here, the drone's energy consumption during instantaneous acceleration or deceleration cannot be ignored. A properly designed speed control is crucial to the power management of the drone. Distributional reinforcement learning is used to control drone acceleration and deceleration to avoid collision risk while minimizing energy consumption according to the reference energy recorded by each drone. We flew drones to gather energy consumption data and, to validate our approach, we subsequently conducted simulations in which travel time and energy consumption were measured. We demonstrate that the proposed kinematics-based drone collision avoidance method exhibits excellent performance in terms of travel time and power management.

Original languageEnglish
Pages (from-to)9763-9775
Number of pages13
JournalIEEE Transactions on Vehicular Technology
Volume73
Issue number7
DOIs
StatePublished - 2024

Keywords

  • Aerodynamics
  • Air-Traffic Intersections
  • Connected-Drones
  • Distributional Reinforcement Learning
  • Velocity Control

Fingerprint

Dive into the research topics of 'Aerodynamics-Based Collision-Free Control of Connected Drones in Complex Urban Low-Altitude Airspace Using Distributional Reinforcement Learning'. Together they form a unique fingerprint.

Cite this