Terminal Iterative Learning Control for Autonomous
Aerial Refueling under Aerodynamic Disturbances

arXiv:1803.00247v1 [] 1 Mar 2018

Xunhua Dai1 , Quan Quan2 , Jinrui Ren3 , Zhiyu Xi4 and Kai-Yuan Cai5
Beihang University, 100191 Beijing, People’s Republic of China

Nomenclature

∆F0

= Bow wave disturbance force

∆pedr

= Drogue position offsets from equilibrium position

∆pdr/pr

= Position error between drogue and probe

∆pdr/pr (T )

= Terminal position error

∆Rdr/pr

= Radial error between hose and drogue

FT

= Tanker joint frame

Fr , Fhd

= Disturbance forces on receiver and hose-drogue

Fbow

= Disturbance force from bow wave effect

pdr (t), ppr (t)

= Current positions of drogue and probe

pdr (T ), ppr (T ) = Terminal positions of drogue and probe

1
2
3
4
5

pe0
dr

= Drogue initial equilibrium position

R, R+

= Real number set and positive real number set

RC

= Threshold radius for a successful docking attempt

T

= Terminal time of a docking attempt

ûpr

= Reference trajectory for autopilot

Ph.D. Candidate, School of Automation Science and Electrical Engineering; dai@buaa.edu.cn.
Associate Professor, School of Automation Science and Electrical Engineering; qq_buaa@buaa.edu.cn.
Ph.D. Candidate, School of Automation Science and Electrical Engineering; renjinrui@buaa.edu.cn.
Associate Professor, School of Automation Science and Electrical Engineering; z.xi@buaa.edu.cn.
Professor, School of Automation Science and Electrical Engineering; kycai@buaa.edu.cn.

1

I.

Introduction

Aerial refueling has demonstrated significant benefits to aviation by extending the range and
endurance of aircraft [1]. The development of autonomous aerial refueling (AAR) techniques for
unmanned aerial vehicles (UAVs) makes new missions and capabilities possible [2], like the ability
for long range or long time flight. As the most widely used aerial refueling method, the probedrogue refueling (PDR) system is considered to be more flexible and compact than other refueling
systems. However, a drawback of PDR is that the drogue is passive and susceptible to aerodynamic
disturbances [3]. Therefore, it is difficult to design an AAR system to control the probe on the
receiver to capture the moving drogue within centimeter level in the docking stage.
It used to be thought that the aerodynamic disturbances in the aerial refueling mainly include
the tanker vortex, wind gust, and atmospheric turbulence. According to NASA Autonomous Aerial
Refueling Demonstration (AARD) project [2], the forebody flow field of the receiver may also significantly affect the docking control of AAR, which is called “the bow wave effect” [4]. As a result, the
modeling and simulation methods for the bow wave effect were studied in our previous works [5, 6].
Since the obtained mathematical models are somewhat complex and there may be some uncertain
factors in practice, this paper aims to use a model-free method to compensate for the docking error
caused by aerodynamic disturbances including the bow wave effect.
Most of the existing studies on AAR docking control do not consider the bow wave effect. In
[7–9], the drogue is assumed to be relatively static (or oscillates around the equilibrium) and not
affected by the flow field of the receiver forebody. However, in practice, the receiver aircraft is
affected by aerodynamic disturbances, and the drogue is affected by both the wind disturbances
and the receiver forebody bow wave. As a major difficulty in the control of AAR, the aerodynamic
disturbances, especially the bow wave effect, attract increasing attention in these years. In [10, 11],
the wind effects from the tanker vortex, the wind gust, and the atmospheric turbulence are analyzed,
and in [5, 6, 12], the modeling and simulation methods for the receiver forebody bow wave effect are
studied, but no control methods are proposed. In [4], simulations show that the bow wave effect can
be compensated by adding an offset value to the reference trajectory, but the method for obtaining
the offset value is not given.

2

Since the accurate mathematical models for the aerodynamic disturbances are usually difficult
to obtain [5], iterative learning control (ILC) is a possible choice for the docking control of AAR.
According to [13], the ILC is a model-free control method which can improve the performance of a
system by learning from the previous repetitive executions or iterations. ILC methods have been
proved to be effective to solve the control problems for complex systems with no need for the exact
mathematical model [14]. For an actual AAR system, the relative position between the probe and
the drogue is usually measured by vision localization methods [15] whose measurement precision
depends on the relative distance (higher precision in a closer distance). Therefore, compared with
the trajectory data, the terminal positions of the probe and the drogue are usually easier to measure
in practice. As a result, terminal iterative learning control (TILC) methods are suitable for AAR
systems because TILC methods need only the terminal states or outputs instead of the whole
trajectories [16, 17].
This paper studies the model of the probe-drogue aerial refueling system under aerodynamic
disturbances, and proposes a docking control method based on TILC to compensate for the docking
errors caused by aerodynamic disturbances. In the ATP-56(B) issued by NATO [18], chasing the
drogue directly is identified as a dangerous operation which may cause the overcontrol of the receiver.
Therefore, the proposed TILC controller is designed by imitating the docking operations of human
pilots to predict the terminal position of the drogue with an offset to compensate for the docking
errors caused by aerodynamic disturbances. The designed controller works as an additional unit
for the trajectory generation of the original autopilot system. Simulations based on our previously
published MATLAB/SIMULINK environment [5, 6] show that the proposed control method has a
fast learning speed to achieve a successful docking control under aerodynamic disturbances including
the bow wave effect.
The paper is organized as follows. Section II gives comprehensive problem description and
model analysis of a PDR system. Section III describes the details of the TILC controller design
and the convergence analysis. Section IV gives simulations with the proposed TILC method. In the
end, Section V presents the conclusions.

3

II.
A.

Problem Formulation

Frames and Notations

yt
FT
ot

xt

zt

p dr

p pr

VT

pr

Fig. 1 Simplified schematic diagram of PDR systems.

Since the tanker moves at a uniform speed in a straight and level line during the docking stage
of AAR, a frame fixed to the tanker body can be treated as an inertial reference frame to describe
the relative motion between the receiver and the drogue. As shown in Fig. 1, a tanker joint frame
FT is defined with the origin Ot fixed to the joint between the tanker body and the hose. FT is a
right-handed coordinate system, whose xt horizontally points to the flight direction of the tanker,
zt vertically points to the ground, and yt points to the right. For simplicity, the following rules are
defined:
(i) All position or state vectors are defined under the tanker joint frame FT , unless explicitly
stated.
T

(ii) The drogue position vector is expressed as pdr , [xdr ydr zdr ] , and the probe position
vector is ppr , [xpr ypr zpr ]T . In a similar way, the position error between the probe and the drogue
is expressed as
∆pdr/pr (t) , pdr (t) − ppr (t)

(1)

whose decomposition form is represented by ∆pdr/pr , [∆xdr/pr ∆ydr/pr ∆zdr/pr ]T .
(iii) One docking attempt ends at the terminal time T ∈ R+ when the probe contacts with the
central plane of the drogue (∆xdr/pr = 0) for the first time, which is defined as

T = min ∆xdr/pr (t) = 0 .
t

(2)

The value at time t = T is called the terminal value. For example, pdr (T ) is the terminal position
of the drogue and ∆pdr/pr (T ) is the terminal position error.
4

(k)

(iv) The value in the k th docking attempt is marked by a right superscript. For example, pdr

denotes the drogue position pdr in the k th docking attempt, T (k) denotes the k th terminal time, and

(k)
pdr T (k) denotes the k th terminal position of the drogue.

B.

System Overview

The overall structure of the AAR system proposed in this paper is shown in Fig. 2, where the
whole AAR system is divided into two parts: the mathematical model and the control system.
The AAR Mathematical model contains three components: the aerodynamic disturbance model,
the hose-drogue dynamic model, and the receiver dynamic model; the control system contains two
components: the autopilot and the TILC controller. The autopilot focuses on stabilizing the aircraft
attitude and tracking the given reference trajectory, and the TILC controller works as a human pilot
that learns from historical experience and sends trajectory commands to the autopilot. This paper
focuses on the design of the TILC controller.

Fig. 2 Overall structure of the AAR system.

C.

Mathematical Model
1.

Aerodynamic Disturbance Model

The aerodynamic disturbances will change the flow field around the receiver and the drogue,
then produce disturbance forces on them to affect their relative motions. There are mainly two
sources of aerodynamic disturbances: one is from the atmospheric environment such as the tanker
vortex, the wind gust and the atmospheric turbulence [10]; the other is from the bow wave flow field

5

of the receiver forebody. In an AAR system, the receiver mainly suffers the atmospheric disturbance
force Fr ∈ R3 , while the hose-drogue suffers both the atmospheric disturbance force Fhd ∈ R3 and
the bow wave disturbance force Fbow ∈ R3 .
The modeling and simulation methods for Fr and Fhd have been well studied in the existing
literature, where the detailed mathematical expression for Fr can be found in [10], the detailed
mathematical expression for Fhd can be found in [5][10]. The bow wave disturbance force Fbow ,
according to [5], is determined by the position error between the drogue and the probe ∆pdr/pr ,
which can be expressed as
Fbow = f bow ∆pdr/pr



(3)

where fbow (·) is the bow wave effect function whose expression can be obtained by the method
proposed in [5].
Among these disturbances, Fr and Fhd are independent of the states of the AAR system, and
the corresponding control methods are mature; Fbow is strongly coupled with the system output
∆pdr/pr , the control strategy for which is challenging and still lacking. Therefore, this paper puts
more effort on the control of the bow wave effect.

2.

Hose-drogue Model

The soft hose can be modeled by a finite number of cylinder-shaped rigid links based on the
finite-element theory [19]. Then, the hose-drogue dynamic equation can be written as



 ẋhd (t) = f hd (xhd (t) ,Fhd (t) , Fbow (t))

(4)



 pdr (t) = ghd (xhd (t))

where f hd (·) is a nonlinear vector function, xhd is the hose-drogue state vector, and Fhd (t) and
Fbow (t) are the disturbance forces acting on the drogue. The dimensions of xhd and f hd (·) depend
on the number of the links that the hose is divided into.
The most concerned value in the TILC method is the terminal position of the drogue. Therefore,
it is necessary to study the terminal state of the hose-drogue system (4). According to [6], when
there is no random disturbance, the drogue will eventually settle at an equilibrium position marked

6

as pe0
dr . Then, under the bow wave effect, the drogue will be pushed to a new terminal position
pdr (T ). The drogue position offset ∆pedr ∈ R3 is defined as
∆pedr = pdr (T ) − pe0
dr

(5)

where ∆pedr is further determined by the strength of terminal bow wave disturbance force Fbow (T )
as
∆pedr = fdr (Fbow (T )) .

(6)

Then, substituting Eq. (3) into Eq. (6) yields


∆pedr = fdr fbow ∆pdr/pr (T ) , f̄dr ∆pdr/pr (T ) .

(7)

Noticing that ∆pdr/pr (T ) ≈ 0, the Taylor Expansion can be applied to Eq. (7), which results in
∆pedr ≈ m0 + M1 · ∆pdr/pr (T )

(8)

where
m0 , f̄dr (0) , M1 ,

∂ f̄dr (x)
∂x

.

(9)

x=0

In practice, the drogue is sensitive to the aerodynamic disturbances, and the actual terminal position
of the drogue always oscillates around its stable position. Therefore, a bounded disturbance term
vdr ∈ R3 should be added to Eq. (7) as
∆pedr = m0 + M1 · ∆pdr/pr (T ) + vdr

(10)

where kvdr k ≤ Bdr represents the position fluctuation of the drogue due to random disturbances
such as atmospheric turbulence. According to Eq. (10), there is a functional relationship between the
terminal docking error ∆pdr/pr (T ) and the drogue bow wave offset ∆pedr . Therefore, it is possible to
use TILC methods to compensate for the bow wave position offset ∆pedr with the terminal docking
error ∆pdr/pr (T ).
The detailed mathematical expression of f̄dr (·) can be obtained through methods in [5], then
the Jacobian matrix M1 can be obtained from Eq. (9). Since f̄dr (·) is monotonically decreasing
along each axial direction, for the receiver aircraft with symmetrical forebody layout, it is easy to
verify that M1 is a negative definite matrix.
7

3.

Receiver Aircraft Model

As previously mentioned, in the docking stage, the tanker joint frame FT can be simplified as
an inertial frame. Under this situation, the commonly used aircraft modeling methods as presented
in [20] can be applied to the receiver aircraft with the following form



 ẋr (t) = fr (xr (t) , Fr (t) ,ur (t))

(11)



 ppr (t) = gpr (xr (t))

where fr (·) is a nonlinear function, xr is the state of the receiver and ur is the control input of the
receiver aircraft.
Since the nonlinear model (11) is too complex for controller design, a linearization method [20]
is applied to Eq. (11) to simplify the receiver dynamic model. Assume the receiver equilibrium state
is xr0 and the trimming control is ur0 , then the linear model can be expressed as



 ∆ẋr (t) = Ar · ∆xr (t) + Br · ∆ur (t) + Gr · Fr (t)

(12)



 ∆ppr (t) = Cr · ∆xr (t)

where ∆xr , xr −xr0 is the state vector of the linearized system, ∆ur , ur − ur0 is the linearized
control input vector and ∆ppr , ppr −ppr0 is the probe position offset from the initial probe position
ppr0 .

D.

Control System
1.

Autopilot

Based on the linear model (12), the autopilot can be simplified as a state feedback controller
[11] in the form as
∆ur (t) = −KP · ∆xr (t) − KI · eI (t)
ėI (t) = ppr (t) − ûpr (t)

(13)
(14)

where ûpr (t) ∈ R3 is the reference trajectory vector of the probe, KP and KI are the gain matrices.
Essentially, Eq. (13) is a PI controller, where −KP · ∆xr (t) is the state feedback control term for
stabilizing the aircraft, and −KI · eI (t) is the integral control term for tracking the given trajectory.
Since it is very convenient to obtain KP and KI through LQR function in MATLAB, the procedures
8

are omitted here. In practice, a saturation function is required for eI (t) in Eq. (13) to slow down
the response speed and resist integral saturation. For instance, the approaching speed should be
constrained within a reasonable range about 0.5m/s∼1m/s, because the probe should have enough
closure speed to open the valve on the drogue safely [2].
As analyzed in [11, 20], when the autopilot (13) is well designed and the disturbance force
Fr (t) ≡ 0, the tracking error can converge to zero
ûpr (t) − ppr (t) → 0, as t → ∞.

(15)

However, in practice, the disturbance force Fr (t) 6= 0 and the terminal time T ≪ ∞, then the
tracking error cannot reach zero at terminal time T . Therefore, an error term should be added to
Eq. (15) at T as
ûpr (T ) − ppr (T ) = vpr

(16)

where vpr ∈ R3 is a bounded random disturbance term with kvpr k ≤ Bpr . The random disturbance
vpr may come from the unrepeatable disturbances such as atmospheric turbulence.

2.

Objective of Docking Control

Fig. 3 Success and failure criteria of a docking attempt [2].

According to [2], in each docking attempt, the receiver should follow the drogue for seconds until
the hose-drogue levels off. Then, the receiver starts to drive the probe to approach the drogue with
a slow constant speed, until the probe hits the central plane of the drogue as shown in Fig. 3. The
basic requirement for the AAR system is that the relative position between the probe and the drogue
(represented by the docking error ∆pdr/pr ) can reach zero at the terminal time T . In practice, the
radial error ∆Rdr/pr ∈ R+ is an important evaluation index for the docking performance which

9

defined in oyz plane as
∆Rdr/pr (t) ,

q
2
2
(t).
(t) + ∆zdr/pr
∆ydr/pr

(17)

Since the docking error is inevitable due to disturbances, a threshold radius (criterion radius) RC ∈
R+ should be defined as
(18)

∆Rdr/pr (T ) < RC .

If criterion (18) is satisfied, a success docking is declared for this docking attempt [2]. Otherwise,
a failure or miss is declared. In fact, according to the previous definition, there is ∆xdr/pr (T ) ≡
0. Therefore, the terminal radial error ∆Rdr/pr (T ) always equals to the terminal docking error
∆pdr/pr (T ).

III.

TILC Design

As shown in Fig. 2, the role of the TILC controller in AAR system is the same as the human pilot
in manned aerial refueling system. The inputs of the TILC controller are the historical terminal
positions of the probe ppr (T ) and the drogue pdr (T ), and the output is the reference tracking
trajectory ûpr (t) which is further sent to the autopilot.

A.

TILC Controller

The docking errors of the AAR system are mainly caused by two factors: the drogue offset
caused by the bow wave effect as described in Eq. (5); and the tracking error caused by the response
lag of the receiver as described in Eq. (16). In order to compensate for these docking errors, a simple
(k)

(k)

and safe control strategy is letting the probe always aims at a predicted fixed position ûpr (t) ≡ ûpr
(k)

during the docking stage. The predicted position ûpr for the autopilot should have the following
form
e0,(k)

û(k)
pr = pdr
e0,(k)

where pdr

(k)

(k)
+ ude,dr + ue,pr

(19)
(k)

∈ R3 is the original stable position of the drogue, ude,dr ∈ R3 is an estimation term for
(k)

the drogue position offset, and ue,pr ∈ R3 is an ILC term to compensate for the tracking error of the
e0,(k)

probe. Note that, since pdr

can be directly measured during the flight, it is treated as a known
10

(k)

(k)

parameter here. Then, ude,dr and ue,pr should be updated in each iteration, and the updating laws
are given below.
(k)

(1) the updating law of ude,dr is given by
(k)

e,(k−1)

(k−1)

ude,dr = Kα · ude,dr + (I − Kα ) · ∆pdr

(20)

where Kα = diag (kα1 , kα2 , kα3 ) with kα1 , kα2 , kα3 ∈ (0, 1) is a constant diagonal matrix, and ∆pedr
is the drogue terminal offset position as defined in Eq. (5) whose iterative feature can be written as
e,(k)

∆pdr

(k)

, pdr




e0,(k)
T (k) − pdr .

(21)

(k)

(2) the updating law of ue,pr is given by
(k−1)
(k−1)
u(k)
e,pr = ue,pr + Kp · epr

(22)

where Kp = diag (kp1 , kp2 , kp3 ) is a constant diagonal matrices with kp1 , kp2 , kp3 ∈ (0, 1) and epr
represents the probe terminal tracking error with the k th iterative feature defined as
e0,(k)

e(k)
pr , pdr

B.



(k)
+ ude,dr − p(k)
T (k) .
pr

(23)

Convergence Analysis

The following theorem provides the convergence condition under which one can conclude the
convergence property of the designed TILC controller in Eq. (19).
Theorem 1. Consider the AAR system described by Eqs. (4)(11)(13) with the structure shown
in Fig. 2. Suppose (i) the autopilot of the receiver aircraft in Eq. (13) is well designed, and the
probe terminal position satisfies Eq. (16); (ii) the TILC controller is designed as Eq. (19), and its
parameters satisfy
0 ≤ kαi < 1, 0 < kpi ≤ 1, i = 1, 2, 3.

(24)


(k)
Then, through the repetitive docking attempts, the docking error ∆pdr/pr T (k) will converge to a
bound
lim

k→∞



(k)
∆pdr/pr T (k) ≤ Bdr/pr

11

(25)

where
q
2 + B2
Bdr/pr = 2 Bpr
dr

(26)

in which Bdr is the random disturbance bound of the drogue position fluctuation as defined in
Eq. (10) and Bpr is the random disturbance bound of the probe tracking error as defined Eq. (16).
In particular, if the random disturbances are negligible, i.e., Bdr = 0, Bpr = 0, then the docking
error will converge to zero as


(k)
∆pdr/pr T (k) → 0, as k → ∞.

(27)

Proof. See Appendix A. 

C.

Discussion
(k)

Essentially, the term ude,dr works as a low-pass filter, which is expected to provide a smooth
(k)

and robust estimation of the drogue offset caused by disturbances. Then, with this term in ûpr ,
the drogue offset can be compensated. The low-pass filter is adopted instead of using the drogue
offset position directly, which is because the drogue is sensitive to disturbances.
(0)

The initial value for the proposed TILC method in Eq. (19) should be set to zero (ude,dr = 0,
(0)

(0)

ue,pr = 0) when there is no historical learning data. In practice, ude,dr has physical significance,
namely the drogue position offset caused by the receiver forebody flow field. Therefore, the initial
(0)

value for ude,dr can be estimated according to the historical learning data, the experience of human
pilots, or the calculation result from the hose-drogue model [19] and the bow wave effect model
[5]. With the pre-estimated initial value, the iteration speed of the proposed TILC method can be
improved.
Unlike other conventional ILC methods, the proposed TILC method does not require the exact
value of the terminal time T and does not require T to be the same between iterations. It only
requires the terminal positions of the drogue and the probe, which is practical for an actual AAR
system.

12

IV.
A.

Simulation and Verification

Simulation Configuration

A MATLAB/SIMULINK-based simulation environment has been developed to simulate the
docking stage of the AAR. The detailed introduction of the modeling methods and the simulation
parameters can be found in the authors’ previous work [5]. A video has also been released to
introduce the AAR simulation environment and demonstrate the TILC simulation results. The
URL of the video is https://youtu.be/VoplDA6D5fA.

B.

TILC Simulation Results
1.

Iterative Learning Process

In order to verify the effectiveness of the proposed TILC method, all the initial values in Eq. (19)
(0)

(0)

are set zeroes as ude,dr = 0, ue,pr = 0, and the learning procedures are shown in Fig. 4.

Fig. 4 Learning process with the proposed TILC method.

In Fig. 4, there are four docking attempts performed in sequence (the four docking attempts
start at time 50s, 100s, 150s and 200s respectively), where the first two docking attempts fail, and
the following two attempts both succeed. In each attempt, the probe moves close to until contact
with the drogue at T (k) (marked by the vertical dotted lines), then the probe returns to the standby
postilion and gets ready for the next docking attempt.
In the first docking attempt as shown in Fig. 4, the receiver remains at the standby position
(5m behind the drogue, with simulation time from 50s to 60s) to observe the drogue movement
and estimate the equilibrium position of the drogue. Then, the receiver approaches the drogue to
perform a docking attempt during the simulation time from 60s to 71s in Fig. 4. The docking control
13

ends at the terminal time T (1) = 71s, and this docking attempt is declared as a failure because the
(1)

radial error ∆Rdr/pr = 0.5m is larger than the desired radial error threshold RC = 0.15m.
With more docking attempts (not presented in Fig. 4) are simulated, a docking success rate
over 90% will be obtained under the given threshold RC = 0.15m. According to the Monte Carlo
simulations, the success rate depends on many factors including the docking error threshold RC , the
strength of the atmospheric turbulence, and other random disturbances. The simulation results are
consistent with results in [2][4]. When the aerodynamic disturbances are strong, both the drogue
position oscillation and the receiver tracking error will be significant, then the success rate will be
low.

2.

Aerodynamic Disturbance Simulations
T

Fig. 5 presents the total aerodynamic disturbance force Ftotal = [∆Fx , ∆Fy , ∆Fz ] applied on
the drogue during the first docking attempt (50s∼71s) in Fig. 4. In this simulation, the tanker vortex
disturbance comes from the model presented in [10], the wind gust and the atmospheric turbulence
come from the MATLAB/SIMULINK Aerospace Blockset based on the mathematical representations from Military Specification MIL-F-8785C, and the bow wave effect disturbance comes from the
authors’ previous work [6]. When the receiver remains at the standby position (50s∼60s in Fig. 5),
the drogue is far away from the receiver and the disturbance forces mainly come from the tanker
vortex and the atmospheric turbulence as illustrated on the left half of Fig. 5. As the receiver moves
closer to the drogue, the receiver bow wave starts to cause a large disturbance force on the drogue

Components of disturbance force on drogue (N)

as illustrated on the right half of Fig. 5.
60

40

The receiver moves close
to the drogue

The receiver remains at
standby position

DFx
20

0

DFy

-20

-40

DFz
a. Drag +back
b. Side Force +right
c. Lift +up

-60

-80
50

52

54

56

58

60

Time (s)

62

64

66

68

70

Fig. 5 Total aerodynamic disturbing force applied on the drogue.

14

A comprehensive simulation is performed to verify the performance of the proposed TILC
method with the initial value from the previous learning results. In addition to the atmospheric
turbulence and the bow wave disturbance as shown in Fig. 5, a wind gust (5m/s in the lateral
direction and vertical direction respectively) is added at 100s to verify the control effect of the
proposed method under aerodynamic disturbances. The simulation results are presented in Fig. 6.
It can be observed from Fig. 6 that, with a good initial value, the docking control succeeds at
the first attempt. Then, the second docking attempt (115s in Fig. 6) fails due to the addition of a
strong wind gust at 100s. In the next two docking attempts (165s and 215s in Fig. 6), the controller
can rapidly recover and achieve successful docking control without being much affected by the wind
gust disturbance. The simulation results demonstrate that the proposed TILC method has a certain
ability to resist the aerodynamic disturbances.

Fig. 6 Simulation with the initial value and the wind gust disturbance.

V.

Conclusions

This paper studies the model of the probe-drogue aerial refueling system under aerodynamic
disturbances, and proposes a docking control method based on terminal iterative learning control
to compensate for the docking errors caused by aerodynamic disturbances. The designed controller
works as an additional unit for the trajectory generation function of the original autopilot system.
Simulations based on our previously published simulation environment show that the proposed
control method has a fast learning speed to achieve a successful docking control under aerodynamic
disturbances including the bow wave effect.

15

Acknowledgments

This work was supported by the National Key Project of Research and Development Plan
under Grant 2016YFC1402500 and the National Natural Science Foundation of China under Grant
61473012.

Appendices
A.

Proof of Theorem 1


(k)
First, define the ppr T (k) as the probe terminal position in the k th docking attempt. Then,
according to Eq. (16), one has


(k)
T (k) = û(k)
p(k)
pr − vpr
pr

(28)

(k)

where, ûpr can be further expressed by Eq. (19), which yields
e0,(k)

pdr



(k)
(k)
(k)
= vpr
− u(k)
T
+ ude,dr − p(k)
e,pr .
pr

(29)

(k)

Meanwhile, according to the definition of epr in Eq. (23), one has
(k)
(k)
e(k)
pr = vpr − ue,pr .

(30)

Thus, substituting Eq. (22) into Eq. (30) gives
(k−1)
(k−1)
e(k)
+ ṽpr
pr = (I − Kp ) · epr

(31)

(k−1)
(k)
(k−1)
ṽpr
, vpr
− vpr
.

(32)

where


(k)
Second, according to Eq. (5), the drogue terminal position pdr T (k) in the k th docking attempt
is given by
(k)

pdr
e0,(k)

where pdr



e,(k)
e0,(k)
+ ∆pdr
T (k) = pdr
e,(k)

is the drogue original equilibrium position, and ∆pdr
e,(k)

According to Eq. (10), ∆pdr

(33)
is the terminal position offset.

comes from the bow wave effect and can be expressed

e,(k)

∆pdr



(k)
(k)
= m0 + M1 · ∆pdr/pr T (k) + vdr .
16

(34)

Thus, the docking error along the iteration axis is given by






(k)
(k)
T (k) .
∆pdr/pr T (k) = pdr T (k) − p(k)
pr

(35)

Substituting Eqs. (33)(34)(35) into Eqs. (20)(21) gives




(k−1)
(k−1)
(k)
(k−1)
+ ṽdr
∆pdr/pr T (k) = A1 · ∆pdr/pr T (k−1) + A2 · epr

(36)

where
−1

A1 , (M1 − I)

−1

(M1 − Kα ) = I− (I − M1 )

(37)

(I − Kα )

A2 , (M1 − I)−1 (Kp + Kα − I)
(k−1)

ṽdr

−1

, (M1 − I)



(k−1)

(k)

− vdr

vdr

(38)



(39)

.

For simplicity, an augmented system is defined as
X(k) = A · X(k−1) + v(k−1)

(40)

where




X(k) , 


(k)
∆pdr/pr

T


(k)

(k)

epr





 (k) 
,v , 



(k)
ṽdr
(k)

ṽpr






(41)





 A1 A2 
 , A3 , I − Kp .
A , 


03×3 A3

(42)

Furthermore, Eq. (41) can be written into the following form
X(k) = Ak · X(0) +

k−1
X

Ai v(k−i) .

(43)

i=0

Since M1 is a negative definite matrix, according to Eqs. (37)(37)(41), it is easy to verify that
the spectral radius of A is smaller than 1 (ρ (A) < 1) when the following constraint is satisfied
(44)

0 ≤ kαi < 1, 0 < kpi ≤ 1, i = 1, 2, 3.
(k)

(k)

(k)

Moreover, since the disturbances vpr and vdr are both bounded with vpr

(k)

≤ Bpr and vdr

≤

Bdr , it is easy to obtain from Eqs. (32)(37)(41) that v(k) is also bounded with
q
2 + B2 .
v(k) ≤ 2 Bpr
dr
17

(45)

Then, substituting Eq. (45) into Eq. (43) gives
X(k)

≤ kAk

k

X(0) +

Pk−1
i=0

i

kAk

v(k−i)

q
Pk−1
i
2 + B2
≤ kAkk X(0) + 2 Bpr
dr
i=0 kAk
q


k
k
2 + B2
= kAk X(0) + 2 Bpr
1
−
kAk
.
dr

(46)

When the constraint in Eq. (44) is satisfied, one has
ρ (A) < 1 ⇒ lim kAkk = 0

(47)

k→∞

which yields from Eq. (46) that
lim

k→∞

X(k) ≤ 2

q
2 + B2 .
Bpr
dr

(48)

According to the definition of X(k) in Eq. (41), one has


(k)
∆pdr/pr T (k) ≤ X(k) .

(49)

Combining Eq. (48) and (49) gives
lim

k→∞

q


(k)
2 + B2 = B
∆pdr/pr T (k) ≤ 2 Bpr
dr/pr .
dr

(50)


(k)
Thus, the docking error ∆pdr/pr T (k) will converge to a bound Bdr/pr as k → ∞. In particular,
(k)

by substituting Bdr = 0, Bpr = 0 into Eq. (50), one has limk→∞ ∆pdr/pr T (k)



= 0.

References
[1] Nalepka, J. P. and Hinchman, J. L., “Automated aerial refueling: extending the effectiveness of unmanned air vehicles,” in “AIAA Modeling and Simulation Technologies Conference and Exhibit,” AIAA
Paper 2005-6005, Aug. 2005,
doi:10.2514/6.2005-6005.
[2] Dibley, R. P., Allen, M. J., and Nabaa, N., “Autonomous Airborne Refueling Demonstration Phase I
Flight-Test Results,” in “AIAA Atmospheric Flight Mechanics Conference and Exhibit,” AIAA Paper
2007-6639, Aug. 2007,
doi:10.2514/6.2007-6639.
[3] Thomas, P. R., Bhandari, U., Bullock, S., Richardson, T. S., and Du Bois, J. L., “Advances in air to
air refuelling,” Progress in Aerospace Sciences, Vol. 71, 2014, pp. 14–35,
doi:10.1016/j.paerosci.2014.07.001.

18

[4] Bhandari, U., Thomas, P. R., Bullock, S., Richardson, T. S., and du Bois, J. L., “Bow Wave Effect in
Probe and Drogue Aerial Refuelling,” in “AIAA Guidance, Navigation, and Control Conference,” AIAA
Paper 2013-4695, Aug. 2013,
doi:10.2514/6.2013-4695.
[5] Dai, X., Wei, Z.-B., and Quan, Q., “Modeling and simulation of bow wave effect in probe and drogue
aerial refueling,” Chinese Journal of Aeronautics, Vol. 29, No. 2, 2016, pp. 448–461,
doi:10.1016/j.cja.2016.02.001.
[6] Wei, Z.-B., Dai, X., Quan, Q., and Cai, K.-Y., “Drogue dynamic model under bow wave in probe-anddrogue refueling,” IEEE Transactions on Aerospace and Electronic Systems, Vol. 52, No. 4, 2016, pp.
1728–1742,
doi:10.1109/TAES.2016.140912.
[7] Tandale, M. D., Bowers, R., and Valasek, J., “Trajectory tracking controller for vision-based probe
and drogue autonomous aerial refueling,” Journal of Guidance, Control, and Dynamics, Vol. 29, No. 4,
2006, pp. 846–857,
doi:10.2514/1.19694.
[8] Zhu, H., Yuan, S., and Shen, Q., “Vision/GPS-based docking control for the UAV Autonomous Aerial
Refueling,” in “Guidance, Navigation and Control Conference (CGNCC), 2016 IEEE Chinese,” IEEE,
2016, pp. 1211–1215,
doi:10.1109/CGNCC.2016.7828960.
[9] Liu, Z., Liu, J., and He, W., “Modeling and vibration control of a flexible aerial refueling hose with
variable lengths and input constraint,” Automatica, Vol. 77, 2017, pp. 302–310,
doi:10.1016/j.automatica.2016.11.002.
[10] Dogan, A., Lewis, T. A., and Blake, W., “Flight data analysis and simulation of wind effects during
aerial refueling,” Journal of Aircraft, Vol. 45, No. 6, 2008, pp. 2036–2048,
doi:10.2514/1.36797.
[11] Lee, J. H., Sevil, H. E., Dogan, A., and Hullender, D., “Estimation of receiver aircraft states and wind
vectors in aerial refueling,” Journal of Guidance, Control, and Dynamics, Vol. 37, No. 1, 2013, pp.
265–276,
doi:10.2514/1.59783.
[12] Khan, O. and Masud, J., “Trajectory analysis of basket engagement during aerial refueling,” in “AIAA
Atmospheric Flight Mechanics Conference,” AIAA Paper 2014-0190, Jan. 2014,
doi:10.2514/6.2014-0190.

19

[13] Bristow, D. A., Tharayil, M., and Alleyne, A. G., “A survey of iterative learning control,” IEEE Control
Systems, Vol. 26, No. 3, 2006, pp. 96–114,
doi:10.1109/MCS.2006.1636313.
[14] Ahn, H.-S., Chen, Y., and Moore, K. L., “Iterative learning control: Brief survey and categorization,”
IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), Vol. 37,
No. 6, 2007, pp. 1099–1121,
doi:10.1109/TSMCC.2007.905759.
[15] Valasek, J., Gunnam, K., Kimmett, J., Junkins, J. L., Hughes, D., and Tandale, M. D., “Visionbased sensor and navigation system for autonomous air refueling,” Journal of Guidance, Control, and
Dynamics, Vol. 28, No. 5, 2005, pp. 979–989,
doi:10.2514/1.11934.
[16] Chen, Y. and Wen, C., Iterative learning control: convergence, robustness and applications, SpringerVerlag, 1999,
doi:10.1007/BFb0110114.
[17] Chi, R., Hou, Z., Jin, S., and Wang, D., “Improved data-driven optimal TILC using time-varying input
signals,” Journal of Process Control, Vol. 24, No. 12, 2014, pp. 78–85,
doi:10.1016/j.jprocont.2014.07.007.
[18] NATO, “ATP-56(B) Air-to-Air Refuelling,” Tech. rep., NATO, 2010.
[19] Ro, K. and Kamman, J. W., “Modeling and simulation of hose-paradrogue aerial refueling systems,”
Journal of Guidance, Control, and Dynamics, Vol. 33, No. 1, 2010, pp. 53–63,
doi:10.2514/1.45482.
[20] Stevens, B. L. and Lewis, F. L., Aircraft Control and Simulation, John Wiley & Sons, 2004,
doi:10.1108/aeat.2004.12776eae.001.

20

