Open Access

ARTICLE

Generation and Simulation of Basic Maneuver Action Library for 6-DOF Aircraft by Reinforcement Learning

by Jinlin Wang¹, Jitao Teng³, Yang He¹, Hongyu Yang^1,*, Yulong Ji^2,*, Zhikun Tang⁴, Ningwei Bai⁵

1 Sichuan University National Key Laboratory of Fundamental Science on Synthetic Vision, Chengdu, 610000, China
2 Sichuan University School of Aeronautics and Astronautics, Chengdu, 610000, China
3 Chinese People’s Liberation Army Unit 93216, Beijing, 10000, China
4 National Airspace Management Center, Linxi, 054900, China
5 Chengdu No. 7 High School, Chengdu, 610000, China

* Corresponding Authors: Hongyu Yang. Email: ; Yulong Ji. Email:

Journal on Internet of Things 2022, 4(2), 85-98. https://doi.org/10.32604/jiot.2022.031043

Received 15 August 2022; Accepted 15 October 2022; Issue published 28 March 2023

Abstract

The development of modern air combat requires aircraft to have certain intelligent decision-making ability. In some of the existing solutions, the automatic control of aircraft is mostly composed of the upper mission decision and the lower control system. Although the underlying PID (Proportional Integral Derivative) based controller has a good performance in stable conditions, it lacks stability in complex environments. So, we need to design a new system for the problem of aircraft decision making. Studies have shown that the behavior of an aircraft can be viewed as a combination of several basic maneuvers. The establishment of aircraft basic motion library will effectively reduce the difficulty of upper aircraft control. Given the good performance of reinforcement learning to solve the problem with continuous action space, in this paper, reinforcement learning is used to control the aircraft’s rod and rudder to generate a basic maneuver action library, and the flight of the aircraft under the 6 degrees of freedom (6-DOF) simulation engine is effectively controlled. The simulation results verify the feasibility of the method on a visual simulation platform.

---

Keywords

---