The sample fraction in peaks-over-threshold problems where the
second-order expansion is valid with specific reference to the
generalized Pareto distribution
J. Martin van Zyl
Department of Mathematical Statistics and Actuarial Science, University of the Free
State, Bloemfontein, South Africa
e-mail: wwjvz@ufs.ac.za

In samples from a heavy-tailed distribution the peaks-over-threshold approach is
often applied and above a threshold the distribution of excesses over the
threshold have asymptotically a generalized Pareto distribution. The tail function
can be approximated by using a second-order expansion and based on the
estimated parameters of the second–order approximation an expression for the
optimal sample fraction of largest order statistics can be derived. Given that the
observations are above the threshold, an expression is derived for the percentile
above which the second-order approximation is valid.
Keywords: peaks-over-threshold, sample fraction, GPD, second order

1. Introduction

In samples from a heavy-tailed distribution the peaks-over-threshold approach (Smith
and Davidson, 1990) is often applied and above a threshold the distribution of excesses
over the threshold has asymptotically a generalized Pareto distribution (GPD),
(Balkema and de Haan(1974), Pickands (1975)). Hall (1982), Hall and Welsh (1985)
considered distribution functions with a positive index, α , for which the tail function

1

can be approximated by using a second-order expansion and based on the estimated
parameters of the second–order approximation an expression for the optimal sample
fraction and bias of the Hill estimator (Hill, 1975) can be derived. Many of the
references on this topic can be found in the review paper by Gomes and Guillou (2015).

Let α denote the index of the excesses over the threshold. Given that the observations
are above the threshold, it will be shown that the expansion is valid for observations
above the 1 − 1/ 2α percentile. An estimate of α can easily be made by using a small
number of the largest observations and applying the Hill estimator (Hill, 1975). This
result can also be used as a lower bound for the threshold since it is the smallest value
for which there is power behaviour in the tails of the distribution. The fact that the
expansion is valid, does not mean it is a good when approximating the tail function, and
to be a good approximation the order statistics should also be larger than one since the
expansion is in terms of the inverse of the order statistics.

It is shown that the same condition hold for the Burr distribution.

The distribution function of the generalized Pareto distribution is

F ( x) = 1 − (1 + (ξ / σ ) x)−α and tail function

1 − F ( x) = (1 + (ξ / σ ) x)−α , x > 0 ,

(1)

2

where ξ = 1/ α the shape parameter, σ a scale parameter, and x an excess over a
threshold µ , or x = z − µ . The second-order approximation introduced by Hall (1982),
Hall and Welsh (1985) is written as

1 − F ( x) = Ax −α {1 + Bx − β + o( x − β )}, x → ∞
≈ cx − a + dx − b ,

(2)

where c > 0, d ≠ 0, b > a > 0 .

In section 2 it will be used to shown that the expansion is valid for a GPD, F , if

F ( x ) > 1 − 2 −α .

(3)

In practice α can be estimated using a small number of the largest excesses and the
proportion calculated by using an approximate threshold. Figures are shown to illustrate
the idea and in section 3 this will be applied to simulated samples for various values of

α.

For the Fréchet distribution it is trivial to show that the expansion is valid for all
observations and any value of the index α . For a standard Fréchet distribution it can be
shown that by using the condition that observations must be larger than one, P ( X > 1) ,
the observations above the upper 1 − 1/ e percentile can be included for a good 2nd order
approximation.

3

2. The second-order approximation applied to a GPD

A theorem will be derived to find the point where the approximation is valid in terms of
percentiles.

Theorem: Let Z1 ,..., Z n denote the largest observations of a sample
and X 1 = Z1 − µ ,..., X n − µ denote the excesses above a threshold , µ . The threshold is
large enough such that the asymptotic distribution of the excesses over the threshold
have a GPD distribution G with scale parameter σ and index α . The second order
approximation applied to the excess is valid for observations such that F ( x) > 1 − 1/ 2α .
If N observations are less than the threshold and n − N larger or equal to the threshold,
the expansion is valid for observations larger than the percentile
F ( x) > ( N / n) + ((n − N ) / n)(1 − 1/ 2α ) .

Proof:

Let G ( x) = 1 − F ( x) = ( x / ασ ) −α (1 + ασ / x) −α . The binomial theorem can be

applied to the term (1 + ασ / x) −α for ασ / x <1. Thus

ασ / x < 1
x / ασ > 1
1 + x / ασ > 2
(1 + x / ασ )α > 2α ,
Thus for
F ( x) = 1 − (1 + x / ασ )−α > 1 − 2 −α ,

4

or G ( x) < 2−α .

An easier way to derive this result is:

P( X > ασ ) = 1 − F (ασ )
= (1 + (1/ ασ )(ασ )) −α
= 2 −α .

In terms of the observed sample it means that Z j ≥ µ + ασ , j = 1,...n .

The Burr distribution with

f ( x) = ταλ α xτ −1 /(λ + xτ )α +1

and

1 − F ( x) = λ α /(λ + xτ )α
= (λ α / x −ατ )(1 + λ / xτ ) −α .

The term (1 + λ / xτ )−α can be expanded into a series in terms of the inverse of x , and
the expansion is valid for λ 1/ α < x , F ( x) > F (λ 1/τ ) = 1 − 2 −α . Thus the largest
observations higher than this percentile must be used for the power expansion to be
valid, and to be a good approximation for x > 1 . The expansion with two terms is

1 − F ( x) ≈ λ α / xατ − αλ α / x (α +1)τ .

5

By making use of the binomial theorem the tail function can be expanded as
series to infinity. The expansion is valid for x > ασ . Denote the second order
approximation by G* ( x) ≈ 1 − F ( x) .

1 − F ( x) = ( x / ασ ) −α (1 + ασ / x) −α
= ( x / ασ ) −α (1 + (−α )( x / ασ ) + (1/ 2)(−α )(−α − 1)( x / ασ ) 2 +
(1/ 6)(−α )(−α − 1)(−α − 2)( x / ασ )3 + ...
≈ (ασ )α x −α − α (α + 2)σ (α +1) x − (α +1) .

The constants are c = (ασ )α , a = α , d = −α (α + 2)σ (α +1) , b = α + 1 , and G* (ασ ) = 1 − α . In
the following figure the second order tail function approximation for a GPD with

σ = 1, α = 2 , is shown as a function of x .

6

tail function and 2nd order approximation

0.4

0.2

0

-0.2

-0.4

-0.6

-0.8

-1

1

1.5

2

2.5

3

3.5
x

4

4.5

5

5.5

6

Figure 1. Second order approximation and true tail function a of GPD, α = 2, σ = 0.5

In the following figure a sample of size n = 250 is simulated from a GPD with
threshold zero, thus similar data as excesses over a threshold. The upper 25% of
observations are used, say m , and G* ( x( j ) ),1 − F ( x( j ) ) plotted on the vertical axis
against the empirical distribution function ( j − 1) / m on the horizontal axis for

j = 1,..., m . The parameters of the GPD are σ = 0.5, α = 1 . As one would expect with

α = 1 , the approximation should be valid for the upper (1 − 2 −α )100 = 50% of
observations. Since the distribution is very heavy tailed these observations are much
larger than one and one can see the second order approximation is not only valid but
also a good approximation of the tail function.

7

tail function and 2nd order approximation

0.35

0.3

0.25

0.2

0.15

0.1

0.05

0

0

0.1

0.2

0.3
0.4
0.5
0.6
0.7
empirical distribution function

0.8

0.9

1

Figure 2. Approximate and true tail function of largest 25% of observations in a sample
of with a GPD distribution with σ = 0.5, α = 1 plotted against the empirical distribution
function. The dashed line is the approximation and the solid line true tail function.

8

0.4

tail function and 2nd order approximation

0.2
0
-0.2
-0.4
-0.6
-0.8
-1
-1.2

0

0.1

0.2

0.3
0.4
0.5
0.6
0.7
empirical distribution function

0.8

0.9

1

Figure 3. Approximate and true tail function of largest 25% of observations in a sample
of with a GPD distribution with σ = 2, α = 2 plotted against the empirical distribution
function. The dashed line is the approximation and the solid line true tail function.

−α

The Fréchet distribution with distribution function F and index α , F ( x) = e − x , the
expansion is valid for any positive value of α and positive x, and it is

1 − F ( x) ≈ x −α − (1/ 2) x −2α .

It can be seen that this series would converge faster for x > 1 and especially for large
values of x . The proportion of observations where x > 1 is F (1) = e −1 . A guideline
would be to use the largest 63% of the observations.

9

For the t -distribution function with ν degrees of freedom and density function

f (t ) = 1/( ν B (ν / 2,1/ 2)(1 + t 2 /ν ) − (ν +1) / 2 ,

It follows that the tail function expansion is valid for t > ν

∞

1 − F ( x) = 1/( ν B (ν / 2,1/ 2) ∫ (ν / t 2 )(ν +1) / 2 (1 −
x

(ν + 1) −2
ν t + ...)dt
2

≈ 1/( ν B (ν / 2,1/ 2)(ν (ν +1) / 2 )(ν −1 x −ν − 0.5ν (ν + 1) /(ν + 2) x − (ν + 2) )
= 1/( B (ν / 2,1/ 2)(ν ν / 2−1 x −ν − 0.5ν ν / 2+1 (ν + 1) /(ν + 2) x − (ν + 2) ) .

The tail function can be calculated exactly by making use of the transformation
x = ν /(ν + t 2 ) and the incomplete beta function. In the point t = ν ,
x = ν /(ν + ( ν )2 ) = 0.5 , and

0.5

1 − F ( ν ) = 0.5(1/ B(ν / 2,0.5)) ∫ tν / 2−1t −0.5 dt .
0

This is tabulated in table 1 for some degrees of freedom. Notice that in practice if the
negative values are taken into consideration the proportions would be twice those
tabulated.

10

Degrees of freedom

ν

P( X > ν )

1

0.25

2

0.1464

3

0.0908

4

0.0581

5

0.0378

6

0.0249

7

0.0166

8

0.0111

9

0.0075

10

0.0051

In the following figure a plot is made of the tail function of a t-distribution with degrees
of freedom , ν = 2 , and a sample of size m = 250 simulated. The largest 25% of the
observations are considered. Thus Fˆ j = ( j − 1) / m against 1 − F ( x( j ) ) and G* ( x( j ) ) ,

j = 1,..., k for k observations considered. The solid line is the tail function and 2nd order
approximation calculated in the points which were observed and plotted against the
empirical distribution function.

11

tail function and 2nd order approximation

0.25

0.2

0.15

0.1

0.05

0

-0.05

-0.1

0

0.1

0.2

0.3
0.4
0.5
0.6
0.7
empirical distribution function

0.8

0.9

1

.
Figure 4. Approximate and true tail function of largest 20% of observations in a sample
of size m = 1000 from a t − distribution with ν = 2 , plotted against the empirical
distribution function. The dashed line is the approximation and the solid line true tail
function.

3. Conclusions

A guideline to choose the fraction of observations above a threshold for which a second
order approximation of the tail function is valid was derived. This can also be used as a
conservative estimate of the threshold. DuMouchel (1983) suggested in the context of
observations from a stable distribution, that not more than largest 10% observations
should be included when using the Hill estimator. Some researchers, for example

12

Galbraith and Zernov (2004) use this rule when using the Hill estimator to measure the
index of heavy-tailed data. In terms of the rule derived here 10% would correspond to

α = 2.3 , and more than 10% of the largest observations can used for heavier tails.

References
Balkema, A., and de Haan, L. (1974). Residual life time at great age, Annals of
Probability, 2, 792–804.
Davison, A.C. and Smith, R.L. (1990). Models for exceedances over high thresholds.
Journal of the Royal Statistical Society. Series B (Methodological)
Vol. 52, No. 3 (1990), pp. 393-442.
DuMouchel, W.M. (1983). Estimating the Stable Index α in Order to Measure Tail
Thickness: A Critique. Annals of Statistics, 11, 1019 – 1031.
Galbraith, J.W. and Zernov, S. (2004). Circuit Breakers and Tail Index of Equity
Returns, Jnl of Financial Econometrics, 2 (1), 109 – 129.
Gomes, M. I., Guillou, A. (2015). Extreme Value Theory and Statistics of Univariate
Extremes: A Review. International Statistical Review, Wiley, 82 (2).
Hall, P. (1982). On simple estimates of an exponent of regular variation, J. Roy.
Statistic. Soc. Ser. B, 44, 37 -42
Hall, P.,Welsh, A.W. (1985). Adaptive estimates of parameters of regular variation.
Ann. Statist. , 13, 331 – 341.
Hill, B.M. (1975). A simple general approach to inference about the tail of a
distribution,” Ann. Statist. 3, 1163 -1174.
Pickands, J. (1975). Statistical inference using extreme order statistics, Annals of
Statistics, 3, 119–131.

13

