Aerospace Control and Guidance Systems Committee

Announcements

You must first log in to access prior meeting presentations, register for a meeting, or nominate some for the Ward Award.

If you do not have a login account, or cannot remember the email address associated with your account, please click on the Application Form link below.

Login

Site Search

Search our site:

Upcoming Events

Photos

Meeting Highlights New!

Subcommittee S

Prior Meetings

Abstracts may be viewed by anyone. Presentations are only available to active members who have logged in.

Meeting 133

Meeting 132
(coming soon)

Home

Ward Memorial Award

Planning Advisory Board

Downloads

Constitution and By-Laws

About

History

Contact Us

← Return to agenda

Meeting	ACGS Committee Meeting 133 - Asheville, NC - November 2024
Agenda Location	6 SUBCOMMITTEE B – MISSILES AND SPACE 6.3 Reinforcement Learning Control of Hypersonic Vehicles and Performance Evaluations
Title	Reinforcement Learning Control of Hypersonic Vehicles and Performance Evaluations
Presenter	Brent Wallace
Affiliation	Raytheon
Available Downloads*	presentation
	Downloads are available to members who are logged in and either Active* or attended this meeting.
Abstract	This work presents a new framework for model-based continuous-time reinforcement learning (CT-RL) control of hypersonic vehicles (HSVs). The predominant classes of CT-RL methods for general nonlinear systems in adaptive dynamic programming (ADP) and deep RL tend to either present substantial theoretical results but lack practical synthesis capability (ADP), or show empirical promise without offering theoretical guarantees (deep RL). Meanwhile, RL control frameworks developed directly for HSVs tend to require a simplified model and complicated control structure, and they lack the substantial numerical evaluations essential for real-world flight implementation. To directly address these challenges, we propose a new decentralized excitable integral reinforcement learning (dEIRL) framework within which the reference input-based exploration improves persistence of excitation (PE). Together with new insights on prescaling and established decentralized control structure for HSVs, we demonstrate the resulting controller for significant performance improvement over classical LQR and feedback linearization methods. Additionally, we provide convergence, optimality, and closed-loop stability guarantees of the proposed method. We demonstrate these performance guarantees over a set of substantial and systematic numerical evaluations on an unstable, nonminimum phase HSV model subject to varying modeling errors and initial conditions.