Abstract
For many years I have taught an advanced statistical inference course for master's students using the text of Casella and Berger [2002]. The book gives a comprehensive treatment of the core topics at a level that avoids measure theory while remaining mathematically precise, but it does not cover the increasingly important concept of copulas. The present notes are intended to complement the book by adding two sections on copulas in a style that is as close as possible to that of the original text. Numbering of definitions, theorems, examples, and exercises is consistent with Casella and Berger [2002], but the material may also be read as a brief, stand-alone introduction to copula theory.
4.10 Copulas
In many applications we wish to model the joint behavior of several random variables while allowing flexible and possibly different models for their marginal distributions. Classical multivariate families (for example, the bivariate normal in Section 3.3 of Casella & Berger (2002)) tie the joint and marginal distributions together quite rigidly. Copulas provide a way to separate these two aspects: the margins and the dependence structure (Joe, 1997; Nelsen, 1999).
In the years leading up to the 2008 financial crisis, a particular dependence model—the Gaussian copula—became widely used on Wall Street to price and manage the risk of complex credit products such as collateralized debt obligations (Salmon, 2009). By summarizing default dependence between thousands of loans in a single, tractable parameter, it allowed rating agencies and banks to turn heterogeneous pools of mortgages into highly rated securities. The simplicity of the formula helped mask the fact that it relied on a very specific and fragile assumption about joint tail behavior: that extreme losses across different loans were, in effect, nearly independent once the linear correlation was set. When housing prices fell nationwide and defaults became simultaneously likely across many regions, this assumption broke down, and the models severely understated the probability of joint defaults. Copulas themselves are not at fault, but this episode illustrates how important it is to understand what a dependence model captures—and, just as importantly, what it leaves out.
In the following we consider solely the bivariate case; higher dimensions are similar in spirit but technically more involved (Joe, 1997; Nelsen, 1999).
4.10.1 Definition and Basic Properties
Recall from Section 4.5 of Casella & Berger (2002) that a bivariate distribution function must be 2-increasing and right-continuous and must have appropriate limits at infinity, see Definition 4.1.1 and the discussion preceding Example 4.5.1 in Casella & Berger (2002). Copulas are special bivariate distribution functions on with uniform marginals (Nelsen, 1999).
Definition 4.10.1. Let . A bivariate copula (or 2-copula) is a function such that:
- (i)
-
(Margins) For every ,
- (ii)
-
(2-increasing) For every and in ,
Thus a copula is itself a bivariate cdf on with uniform marginals, in the sense of Definition 4.1.1 of Casella & Berger (2002), see (Nelsen, 1999). Three special copulas will be useful:
Definition 4.10.2. The following functions from to are called the product, lower Fréchet, and upper Fréchet copulas, respectively: for .
These correspond, respectively, to independence, perfect negative monotone dependence, and perfect positive monotone dependence (Nelsen, 1999). As in the inequalities for general bivariate distributions (Section 4.5 of Casella & Berger (2002)), one can show that for any copula , Proof: Let be a copula on , and fix . Since is a bivariate distribution function, it is nondecreasing in each coordinate. If , then by monotonicity in the second coordinate and the boundary condition , If , then by monotonicity in the first coordinate and , Thus . For the lower bound, use the 2-increasing property with , , , and to obtain Using the boundary conditions , , and , this becomes or . Because any copula is a cdf, , so Combining the two inequalities yields for all .
The copula corresponds to the case of independent random variables (see Definition 1.3.3 of Casella & Berger (2002)); and correspond to the Fréchet bounds in the general dependence ordering (Nelsen, 1999).
4.10.2 Sklar’s Theorem
The central result connecting copulas with joint distributions is due to Sklar (1959) . It shows how any joint cdf studied in Sections 4.1 and 4.5 of Casella & Berger (2002) can be decomposed into its marginals (Sections 4.1 and 4.2) and a copula.
Theorem 4.10.3 (Sklar’s Theorem). Let be the joint cdf of a pair of random variables with marginal cdfs and .
- (a)
-
There exists a copula such that
- (b)
-
If and are continuous, then is unique.
Conversely, if is any copula and are univariate cdfs, then is a bivariate cdf with marginals and .
Proof of the continuous margin case: For , define and let denote the joint cdf of . For part (a), we must construct a function on such that .
First suppose that and are continuous and strictly increasing. Then each cdf has a (generalized) inverse and , and for any we may define If and , then and , so which gives the desired representation. It is routine to check from the properties of and the marginals that satisfies the copula axioms and has uniform margins on .
For part (b), now suppose that and are continuous. If and are copulas such that for all , then for any we can write and for some , and hence Thus on , so the copula is unique when the marginals are continuous.
For the converse, let be any copula and let and be univariate cdfs. Define Since is a bivariate cdf on and are cdfs on , the composition is nondecreasing in each argument, right continuous, and has the correct limits at , so is a bivariate cdf. Moreover, and similarly , so the marginals of are and . This completes the proof.
If the marginal cdfs are continuous but not strictly increasing, the same formula, interpreted with generalized inverses, yields the copula uniquely on the relevant range and extends uniquely by continuity to . If one or both marginal cdfs are discontinuous, Sklar’s representation in part (a) remains valid, but constructing a copula on the whole unit square requires an additional extension argument. In that case the copula is uniquely determined only on see, for example, (Nelsen, 1999). For the continuous models considered below, the preceding construction gives the required copula directly and uniquely.
Example 4.10.4 (Exponential margins with dependence). Let and be nonnegative random variables with exponential marginals and suppose their joint cdf is for some copula .
- (a)
-
If (the product copula), then for all , and and are independent (Section 1.3).
- (b)
-
If instead we take, for some , the so-called Clayton copula we obtain a model with the same exponential marginals but positive lower tail dependence (Section 4.10.4). In this case, small simultaneous values of and are more likely than under independence, even though the marginal distributions are unchanged.
This example shows how the copula isolates the dependence structure from the choice of marginal distributions.
Thus any bivariate distribution with continuous marginals can be decomposed into its margins and a copula that encodes the dependence structure (Nelsen, 1999). Conversely, by choosing any margins (for example, from the families in Chapter 3 of Casella & Berger (2002)) and any copula, we obtain a valid bivariate distribution.
4.10.3 Probability Integral Transform and Invariance
Sklar’s theorem is closely tied to the probability integral transform, which appeared implicitly in Section 2.1 of Casella & Berger (2002) when we discussed distributions of functions of a random variable (see, e.g., Nelsen, 1999).
If has continuous cdf , then is Uniform; similarly, if has cdf , then is Uniform. (Compare this with the construction of random variables from uniforms in Section 5.5 of Casella & Berger (2002)) If has copula , then Hence copulas are exactly the joint distributions of the transformed pair . This is a specific instance of the general transformation ideas in Chapter 2 of Casella & Berger (2002).
Copulas are invariant under strictly increasing transformations of the margins. This invariance is analogous to the invariance principles discussed later in Chapter 6 of Casella & Berger (2002), but here at the level of probability models rather than estimators.
Theorem 4.10.5 (Invariance). Let be continuous with copula . Let and be strictly increasing functions, and define , . Then has the same copula (Nelsen, 1999).
Proof: Let and be the marginal cdfs of and , and let be their joint cdf. Since has copula , Sklar’s Theorem (Theorem 4.10.3) implies Because and are strictly increasing, the events and are equivalent to and , respectively. Thus, for , Let and be the marginal cdfs of and . Since and are strictly increasing, Hence, for , This is exactly the Sklar representation of with copula , so has the same copula as .
Example 4.10.6 (Ranks and the empirical copula). Suppose , , is a random sample from a continuous bivariate distribution with copula . Let be the rank of among , and let be the rank of among . Define the pseudo-observations Each lies in , and these points can be viewed as a sample from an approximation to , whose joint distribution is the copula . The empirical copula is then As increases, converges to for each fixed , in a manner analogous to the convergence of the empirical cdf to the true cdf later in Section 5.4. Thus, the dependence structure can be studied using only the ranks, without specifying the marginal distributions.
Thus the copula depends only on the rank structure of the data and not on the particular marginal scales. This is the basis for rank-based inference for copula models (see Section 7.2 of Casella & Berger (2002), where rank-based procedures are used for correlation and nonparametric measures of association).
If or is decreasing, the copula transforms in a simple way (for example, via reflections), but the dependence structure remains fully described at the copula level (Nelsen, 1999).
4.10.4 Dependence Concepts and Measures
Copulas formalize several notions of dependence and yield measures that are invariant under monotone transformations (Joe, 1997; Nelsen, 1999). Earlier in the book, dependence was described in terms of independence (Section 1.3 of Casella & Berger (2002)), covariance, and correlation (Section 2.2 of Casella & Berger (2002)). These classical measures depend on second moments and are not invariant under nonlinear transformations. Copula-based measures remedy this.
Definition 4.10.7. Random variables and are said to be positively quadrant dependent (PQD) if for all . Equivalently, in terms of the copula ,
Negative quadrant dependence (NQD) is defined by reversing the inequality. Because PQD can be expressed entirely in terms of the copula, it is invariant under strictly increasing transformations of the margins, in contrast with Pearson correlation (see the discussion at the end of Section 2.2 of Casella & Berger (2002)).
Definition 4.10.8. Kendall’s is a widely used measure of concordance that depends only on the copula. For a continuous bivariate distribution with copula , where and are independent copies.
Kendall’s satisfies:
, with (resp. ) if and only if (resp. ), that is, perfect increasing (resp. decreasing) functional dependence.
if and are independent (i.e., ); compare this with in Section 2.2 of Casella & Berger (2002).
is invariant under strictly monotone transformations of and/or .
In practice, is estimated by the sample proportion of concordant minus discordant pairs, based only on the ranks (see also rank-based methods in Chapter 7 of Casella & Berger (2002)), cf. (Nelsen, 1999).
Definition 4.10.9. Spearman’s is the ordinary correlation of the rank variables and can also be expressed in terms of the copula. Let , ; then
Example 4.10.10 (Pearson correlation versus Spearman’s ). Let be standard normal, and define . Then is a strictly increasing function of , so the copula of is the upper Fréchet bound . In particular, both Kendall’s and Spearman’s are equal to for this pair.
However, Pearson’s correlation coefficient between and is strictly less than , because the relationship between and is nonlinear. This illustrates how copula-based measures such as and capture monotone dependence, while Pearson correlation measures only linear association (Section 2.2 of Casella & Berger (2002)).
Spearman’s shares properties analogous to Kendall’s : it is bounded between and , equals for or , is under independence, and is invariant under strictly increasing transformations of the margins (Nelsen, 1999). Unlike Pearson correlation (Section 2.2 of Casella & Berger (2002)), is defined without second-moment assumptions.
These measures are especially useful for parametric copula families, where or can be expressed as simple functions of the dependence parameter and inverted to give rank-based estimators (cf. the method of moments in Section 7.2 of Casella & Berger (2002)).
Definition 4.10.11. Copulas also describe extremal dependence well. The lower tail dependence coefficient is when the limit exists. The upper tail dependence coefficient is
These quantities depend only on the copula and measure the strength of dependence in the joint lower and upper tails, respectively. For example, the Gaussian copula (see next example) with correlation has , so extreme events are asymptotically independent even when the linear correlation is high (Joe, 1997).
Example 4.10.12 (Gaussian and Gumbel tail behavior). Consider two dependence models with standard normal marginals:
- (a)
-
A bivariate normal model with correlation , whose copula is the Gaussian copula , where denotes the bivariate normal cdf with zero means, unit variances, and correlation coefficient as in Example 3.3.5 of Casella & Berger (2002).
- (b)
-
A Gumbel copula with parameter , combined with standard normal marginals via Sklar’s Theorem.
In both cases, Kendall’s and Spearman’s can be chosen to be similar by an appropriate choice of , so the overall strength of dependence is comparable. However, the Gaussian copula has , so the probability of very large simultaneous exceedances decays as if the tails were asymptotically independent. In contrast, the Gumbel copula has (and ), making simultaneous large positive extremes substantially more likely.
Concretely, as for the Gaussian copula Kendall’s is setting yields For the Gumbel copula Kendall’s is So we set Solving for , and corresponding .
This example underscores how copulas allow us to tune not only the overall dependence but also the extremal (tail) dependence.
4.10.5 Visualization of Copulas
Copulas may be visualized most naturally through their behavior on the unit square. One approach is to plot the copula cdf as a surface over ; for example, the independence copula appears as the smooth surface , while strong positive dependence pulls the surface upward toward the upper Fréchet bound . For absolutely continuous copulas it is also useful to plot the so-called copula density , where regions of high density indicate values of that occur more frequently. In applied work, empirical copulas are often examined by scatterplots of the pseudo-observations , or by contour plots and heatmaps on the unit square, which display the dependence structure independently of the marginal distributions.
In Figure 4.10.1 we plot three such scatterplots generated by the Mathematica code given in Example A.0.9 in the Appendix. These illustrate how different copulas, even with the same margins and similar Kendall’s , can encode very different dependence structures, particularly in the tails (Joe, 1997; Nelsen, 1999).
7.6 Inference for Copula Models
Suppose that is a random sample from a distribution with continuous marginals and copula indexed by a parameter . The likelihood for decomposes into marginal and copula parts, paralleling the decomposition of models into components that underlies the likelihood principle in Chapter 6 of Casella & Berger (2002), see, for example, Joe (1997).
Because the copula is invariant under strictly increasing transformations of the margins, it is natural to base inference about on the ranks (or, equivalently, on empirical versions of and ). Let and be the ranks of and among and , respectively. The empirical copula is defined on by
This is a rank-based estimator of ; under mild conditions, for each fixed (Genest & Favre, 2007). The use of ranks parallels the rank-based procedures for nonparametric inference introduced in Chapter 8 of Casella & Berger (2002).
Although full maximum likelihood estimation is certainly possible, it could be numerically unstable. Several other rank-based estimation strategies are used in practice:
Method of moments via Kendall’s tau or Spearman’s rho. If (or ) is known in closed form, one can estimate by solving (or ), where or is computed from the sample ranks (Section 7.2 of Casella & Berger (2002)), cf. (Genest & Favre, 2007).
Maximum pseudolikelihood. If the copula has density , one may maximize with respect to . Under suitable conditions, the maximizer is consistent and asymptotically normal, and its large-sample behavior can be analyzed using the methods of Chapter 10 of Casella & Berger (2002), cf. (Joe, 1997).
Two-step methods. One may first estimate marginal parameters by univariate methods (Chapter 7 of Casella & Berger (2002)) and then estimate by maximizing a “copula likelihood” built from the transformed data, but this approach is sensitive to misspecification of the margins (Joe, 1997).
Rank-based methods have the advantage of depending only on the copula and remaining valid under arbitrary strictly increasing marginal transformations, in line with the invariance considerations emphasized in Chapter 6 of Casella & Berger (2002), cf. (Genest & Favre, 2007).
Example 7.6.1 (Estimating a Clayton copula parameter). Suppose , , is a sample from a model with continuous marginals and Clayton copula
For this family, Kendall’s tau is a simple function of : Let be the sample Kendall’s tau computed from the ranks of the data. A method-of-moments estimator of is obtained by solving , which gives
This estimator depends only on the copula (through the ranks) and not on the specific marginal distributions, in contrast with likelihood-based estimators that require a full specification of the marginals (Chapter 7 of Casella & Berger (2002)).
Exercises for Section 4.10
- 4.66
-
(Copulas and monotone transformations.) Let be continuous with copula , and let , with strictly increasing.
-
- (a)
-
Using the change-of-variables ideas from Section 2.1, express the cdf of in terms of .
- (b)
-
Show that has the same copula .
- (c)
-
Let be the bivariate normal pair of Example 4.5.3 of Casella & Berger (2002) with correlation . Take and . Simulate a moderate sample from this model (see Section 5.5 of Casella & Berger (2002)) and compare the scatter plots of and . Explain why the copula, and thus Kendall’s tau, is the same in both cases.
- 4.67
-
(PQD and covariance sign.) Suppose is continuous and positively quadrant dependent:
-
- (a)
-
Express this condition in terms of the copula .
- (b)
-
Show that if and have finite second moments, then (hint: proceed as in the proof of Theorem 2.2.6 of Casella & Berger (2002), but use the PQD condition).
- (c)
-
Consider the model of Example 4.5.2 of Casella & Berger (2002), where and are independent exponentials with parameter (hence ). Modify this model by introducing a Clayton copula with parameter while keeping the same exponential marginals. Argue that the resulting pair is PQD, and discuss how the covariance changes.
- 4.68
-
(Gaussian copula and tail independence.) Let be bivariate normal with correlation (Section 3.3 of Casella & Berger (2002)), and define , .
-
- (a)
-
Argue that the copula of is the Gaussian copula .
- (b)
-
Using the tail dependence formulas in Section 4.10.4, show heuristically that for , .
- (c)
-
Explain in words why this means that even strongly correlated Gaussian models may understate the probability of joint extreme events.
Exercises for Section 7.6
- 7.67
-
(Kendall’s and Archimedean copulas.) An Archimedean copula has the form where is a convex, decreasing generator.
-
- (a)
-
For the Clayton copula with parameter , verify that the generator is .
- (b)
-
Using the following formula for Kendall’s in terms of the generator derive and base an estimator for on it.
- 7.68
-
(A complete copula analysis of rainfall and runoff) The following display contains invented paired observations of rainfall , measured in millimetres, and same-day runoff volume , measured in , from substantial rainfall events in a small catchment. For the purposes of this exercise, regard the pairs as an i.i.d. sample from a continuous bivariate distribution. There are no ties.
-
Invented rainfall–runoff data for Exercise 7.68.
1 34.7 64.1 11 114.2 105.0 21 35.6 58.1 2 26.8 19.1 12 15.5 17.5 22 50.8 20.3 3 42.1 71.1 13 14.5 21.5 23 97.4 87.7 4 12.9 27.3 14 33.3 42.0 24 57.2 117.8 5 20.1 24.8 15 21.1 13.1 25 34.0 17.2 6 73.5 88.3 16 38.1 45.6 26 16.9 33.9 7 111.9 119.3 17 20.3 41.3 27 13.1 11.5 8 15.7 26.9 18 19.1 22.8 28 27.6 17.4 9 14.0 10.6 19 45.6 39.2 29 40.3 110.0 10 37.9 58.3 20 23.8 22.9 30 33.6 42.5 -
- (a)
-
Draw a scatterplot of . Describe the marginal distributions and the apparent association. Explain why fitting a bivariate normal distribution on the original measurement scale may be questionable.
- (b)
-
Compute Pearson’s sample correlation , Kendall’s sample tau , and Spearman’s sample rho . Explain why and are particularly natural summaries in a copula analysis.
- (c)
-
Let and denote the ranks of and , respectively. Construct the pseudo-observations Plot the points in the unit square. Explain why this plot, and hence the empirical copula, is unchanged if and are replaced by and , respectively.
- (d)
-
Define the empirical copula by Compute , , and . Compare these values with those of the independence copula .
- (e)
-
Fit a Gaussian copula and a Gumbel copula by inversion of Kendall’s tau. Use and Obtain the estimates and .
- (f)
-
Estimate the same two copulas by maximum pseudolikelihood. For a copula density , maximize For the Gaussian copula, you may use where is the standard normal density and is the bivariate standard normal density with correlation . For the Gumbel copula you may evaluate the mixed derivative numerically, or use software that implements this density like Mathematica. Report the maximum-pseudolikelihood estimates and , and compare them with the estimates from part (e).
- (g)
-
State the lower- and upper-tail dependence coefficients for each fitted copula. In particular, show that the Gaussian copula has whenever , whereas the Gumbel copula has Explain why copulas with similar fitted values of Kendall’s tau can nevertheless make substantially different assertions about simultaneous extreme rainfall and runoff events.
- (h)
-
Using the pseudo-observation plot together with the maximized pseudo-log-likelihoods and the tail-dependence coefficients obtained above, discuss which model is more appropriate for describing the data. Distinguish carefully between overall positive association and upper-tail dependence.
- (i)
-
Let and be the empirical quantiles of rainfall and runoff. For each fitted copula, estimate Compare the resulting estimates with the independence benchmark . Give a practical interpretation in terms of the occurrence of a high-rainfall event together with high runoff.
Further Reading
For a systematic treatment of copulas, their properties, and many families and examples, see Nelsen (1999). A more advanced monograph with emphasis on multivariate dependence and extreme-value structures is Joe (1997). For an accessible introduction to inference for copula models based on ranks, with a detailed worked example and another hydrological application, see Genest & Favre (2007).
Acknowledgement
The author thanks Perplexity AI for assistance with English-language editing and with the preparation and refinement of selected Mathematica code snippets. This assistance was limited to matters of presentation, wording, and coding style. Responsibility for the scientific content, mathematical correctness, numerical calculations, and final form of the manuscript rests entirely with the author.
Appendix
Example A.0.9 (Copula Scatterplots) The following Mathematica code generates scatterplots of pseudo-observations from three copula models with comparable overall dependence: a Clayton copula with parameter , a Gaussian copula with correlation , and a Gumbel copula with parameter .
(* ============================================== *)
(* Copula scatterplots: Clayton, Gaussian, Gumbel *)
(* ============================================== *)
SeedRandom[12345];
n = 5000;
(* ---------------------------------------------- *)
(* 1. Clayton copula, parameter theta = 2.88 *)
(* ---------------------------------------------- *)
thetaClayton = 2.88;
(* Correct Clayton sampler using conditional distribution *)
claytonSample[n_, theta_] := Module[{u, w, v},
u = RandomReal[{0, 1}, n];
w = RandomReal[{0, 1}, n];
v = ((w^(1/(1 + theta)) * u)^(-theta) + 1 - u^(-theta))^(-1/theta);
Transpose[{u, v}]
];
claytonData = claytonSample[n, thetaClayton];
(* ---------------------------------------------- *)
(* 2. Gaussian copula, parameter rho = 0.8 *)
(* ---------------------------------------------- *)
rho = 0.8;
sigma = {{1, rho}, {rho, 1}};
gaussianSample[n_, sigma_] := Module[{z},
z = RandomVariate[MultinormalDistribution[{0, 0}, sigma], n];
CDF[NormalDistribution[0, 1], #] & /@ z
];
gaussianData = gaussianSample[n, sigma];
(* ---------------------------------------------- *)
(* 3. Gumbel copula, parameter theta = 2.44 *)
(* ---------------------------------------------- *)
thetaGumbel = 2.44;
(* Positive alpha-stable sampler, alpha = 1/theta *)
positiveStableSample[alpha_] := Module[{V, E},
V = RandomReal[{0, Pi}, 1][[1]];
E = RandomVariate[ExponentialDistribution[1]];
(Sin[alpha V]/(Sin[V])^(1/alpha)) *
(Sin[(1 - alpha) V]/E)^((1 - alpha)/alpha)
];
(* Marshall-Olkin sampler for Gumbel copula *)
gumbelSample[n_, theta_] := Module[{alpha, s, e1, e2, u, v},
alpha = 1/theta;
Table[
s = positiveStableSample[alpha];
e1 = RandomVariate[ExponentialDistribution[1]];
e2 = RandomVariate[ExponentialDistribution[1]];
u = Exp[-(e1/s)^alpha];
v = Exp[-(e2/s)^alpha];
{u, v},
{n}
]
];
gumbelData = gumbelSample[n, thetaGumbel];
(* ---------------------------------------------- *)
(* 4. Scatterplots *)
(* ---------------------------------------------- *)
plotStyle[color_] := Directive[color, PointSize[0.0025], Opacity[0.5]];
claytonPlot = ListPlot[
claytonData,
PlotRange -> {{0, 1}, {0, 1}},
AspectRatio -> 1,
PlotStyle -> plotStyle[Blue],
AxesLabel -> {"u", "v"},
PlotLabel -> "Clayton Copula, \[Theta] = 2.88",
ImageSize -> 350
];
gaussianPlot = ListPlot[
gaussianData,
PlotRange -> {{0, 1}, {0, 1}},
AspectRatio -> 1,
PlotStyle -> plotStyle[Red],
AxesLabel -> {"u", "v"},
PlotLabel -> "Gaussian Copula, \[Rho] = 0.8",
ImageSize -> 350
];
gumbelPlot = ListPlot[
gumbelData,
PlotRange -> {{0, 1}, {0, 1}},
AspectRatio -> 1,
PlotStyle -> plotStyle[Darker[Green]],
AxesLabel -> {"u", "v"},
PlotLabel -> "Gumbel Copula, \[Theta] = 2.44",
ImageSize -> 350
];
GraphicsRow[{claytonPlot, gaussianPlot, gumbelPlot}, Spacings -> 20]
Solutions
Solution to 4.66.
Let be a continuous bivariate random vector with joint cdf and copula , and let be strictly increasing functions. Define
(a) Cdf of in terms of .
For any , Since and are strictly increasing, the inequalities and are equivalent to where and denote the (strictly increasing) inverses of and . Hence
(b) Copula of .
Let and be the marginal cdfs of and , and let and be the marginal cdfs of and . From part (a),
Let and define Using and the strict monotonicity of , so that Similarly,
The copula of is defined by Using part (a) and the relations above, By definition of the copula of , hence Therefore has the same copula as .
(c) Bivariate normal example and invariance of the copula.
Let be bivariate normal with correlation , as in Example 4.5.3 of Casella & Berger (2002), and define To simulate a sample of size from this model, one can:
Generate i.i.d. observations from the bivariate normal distribution with correlation .
For each , set
The scatter plot of is obtained from that of by applying strictly increasing transformations in each coordinate. These change the marginal distributions (normal to lognormal and scaled lognormal) and the scale of the axes, but they preserve the ordering of the points in each coordinate and hence the dependence structure encoded by the copula.
Part (b) shows rigorously that strictly increasing transformations in each margin leave the copula unchanged. Kendall’s tau is a measure of concordance that depends only on the copula (it is invariant under strictly increasing transformations of each coordinate). Therefore and have the same copula and the same value of Kendall’s tau; empirically, the estimated tau from the two scatter plots will (up to sampling error) be equal.
Solution to 4.67.
Assume is continuous with joint cdf , marginals , and copula .
(a) PQD in terms of the copula.
Positive quadrant dependence (PQD) means In terms of the cdfs this is By Sklar’s theorem, Let and ; then and the PQD condition becomes Thus is PQD if and only if its copula satisfies on .
(b) PQD implies nonnegative covariance.
Assume and have finite second moments. We show . Recall that for square–integrable one can write which is obtained by expanding into indicator integrals and interchanging expectation and integration (as in the proof of Theorem 2.2.6).
Note that and Hence Therefore
If is PQD, then for all , so the integrand is everywhere nonnegative. The integral of a nonnegative function is nonnegative, hence
(c) Clayton copula with exponential marginals.
In Example 4.5.2, and are independent exponentials with parameter : and
Now keep these marginals but introduce dependence via a Clayton copula with parameter : The joint cdf of the new pair is
PQD: For Clayton copulas with one has Thus the copula lies above the independence copula , so by part (a) the resulting pair is positively quadrant dependent.
Covariance: By part (b), PQD and finite second moments imply When (interpreted as a limit), the copula reduces to the product copula , i.e. independence, so For , the resulting pair is positively quadrant dependent and hence has nonnegative covariance. Increasing corresponds to stronger positive dependence within the Clayton family. Thus introducing a Clayton copula with parameter , while keeping the exponential marginals, turns the originally independent pair into a positively quadrant dependent pair with nonnegative covariance.
Solution to 4.68.
Let be bivariate normal with correlation , and let where is the standard normal cdf.
(a) Copula of .
By construction, where are the marginal cdfs of . Thus and are standard uniform random variables (probability integral transform). Their joint cdf is where is the bivariate normal cdf with correlation . By definition, the copula associated with this bivariate normal distribution is Comparing the two displays, we see that has copula (the Gaussian copula with parameter ).
(b) Tail dependence for .
Recall the upper and lower tail dependence coefficients for a copula :
For the Gaussian copula , we have Equivalently,
Upper tail. Write For a bivariate normal with , it is known (and can be derived via asymptotic analysis of the joint normal tail) that for some positive constant depending on . On the other hand, Therefore If , then , so the exponent is negative and the ratio decays to as . Translating back to the copula formulation, this means
Lower tail. By symmetry of the bivariate normal about , and have the same joint distribution (with the same correlation ). Thus lower–tail events correspond to upper–tail events for ; the same asymptotic analysis applies and yields
Heuristically, for any fixed strictly less than in magnitude, the joint tail of the bivariate normal decays faster than the marginal tail, so the conditional probability of a joint extreme given a marginal extreme goes to zero in both tails.
(c) Interpretation for joint extremes.
The fact that for means that, in a Gaussian copula model, the probability of observing one variable in an extreme tail given that the other is in that tail tends to as we move further into the tail. In other words, even if the linear correlation is large (say ), the Gaussian dependence structure does not create asymptotic clustering of extremes: very large values of and do not tend to occur together with positive limiting probability.
In practical terms, this implies that strongly correlated Gaussian models can substantially understate the probability of joint extreme events. They may fit well in the center of the distribution (capturing linear correlation), but they impose tail independence: extreme events in one margin are, asymptotically, almost never accompanied by simultaneous extremes in the other margin. For applications where joint tail behavior is critical (e.g. financial or environmental risk), the Gaussian copula may therefore give overly optimistic (too small) estimates of joint extreme risks.
Solution to 7.67
An Archimedean copula has the form where is a convex, decreasing generator.
- (a)
-
Clayton generator.
-
The (bivariate) Clayton copula with parameter is
-
We claim that this can be written in Archimedean form with generator
-
First compute its inverse: Hence
-
Now form the Archimedean copula associated with this generator:
-
This is exactly the (alternative) Archimedean representation of the Clayton copula, so is indeed a valid generator for the Clayton family.
- (b)
-
Kendall’s and an estimator for .
-
For an Archimedean copula with generator , Kendall’s is given by
-
For we have Therefore
-
Plugging into the formula for ,
-
Compute the integral: Hence
-
Substitute back:
-
Thus Kendall’s for this Clayton copula (with generator ) is
-
To base an estimator for on Kendall’s , let denote the sample (empirical) Kendall’s . We invert the above relationship:
-
This is the method-of-moments–type estimator of the Clayton parameter based on Kendall’s .
Solution to 7.68
Write . The data are listed in random observation order; that order has no statistical significance. There are no ties. In the copula calculations below, we use the rank pseudo-observations
- (a)
-
The scatterplot shows a clear positive association, but it is far from a deterministic functional relationship. There is substantial variation in runoff at comparable rainfall amounts; for example, the observations with rainfall near – mm have runoff values ranging from about to in the stated units. This is plausible because runoff also depends on antecedent wetness, rainfall intensity and duration, catchment storage, routing, and measurement variation.
-
Both variables are positive and right-skewed. Consequently, a bivariate normal model on the original scale is unattractive: normal margins are symmetric and place positive probability on negative rainfall and runoff. Logarithmic transformations may improve marginal plots, but they do not change the copula, because they are strictly increasing on the positive half-line.
- (b)
-
The numerical summaries are Thus the sample displays moderately strong positive association. Pearson’s measures linear association on the original measurement scales and can change under nonlinear increasing transformations. In contrast, Kendall’s tau and Spearman’s rho depend only on the joint ranks and hence are invariant under strictly increasing transformations of either margin. This makes them especially natural for a copula analysis.
- (c)
-
The rank pseudo-observations are obtained from the following ranks: The plot of in the unit square shows positive rank association with appreciable scatter. If rainfall and runoff are replaced by and , respectively, their ranks do not change because the logarithm is strictly increasing. Therefore neither the pseudo-observations nor the empirical copula changes.
- (d)
-
Direct counting yields Under independence, the corresponding values are The empirical copula exceeds the independence copula at all three selected points, which is consistent with positive quadrant dependence in the sample. The comparison at must be interpreted cautiously: with only 30 observations, very few data points concern the most extreme part of the unit square.
- (e)
-
Inversion of the stated Kendall-tau relationships gives and Thus both copulas are fitted to the same global rank-dependence summary.
- (f)
-
Maximizing the rank-based pseudo-log-likelihood gives, numerically, At their respective maxima, the pseudo-log-likelihood values are approximately The two estimation methods give broadly similar dependence levels. For this sample, the fitted Gumbel copula has the larger maximized pseudo-log-likelihood. This comparison is descriptive; with , it should not be interpreted as decisive evidence for an upper-tail-dependent model.
- (g)
-
For every Gaussian copula with , For a Gumbel copula, Using the maximum-pseudolikelihood estimate yields Using the inversion-of-tau estimate instead gives
-
Hence the Gaussian and Gumbel copulas can describe broadly comparable ordinary rank association while making different assertions about extreme events. The Gaussian copula is asymptotically tail independent: as the threshold tends to one, joint exceedances become negligible relative to a marginal exceedance. The Gumbel copula retains positive upper-tail dependence.
- (h)
-
The pseudo-observations show a broadly increasing cloud rather than a concentration exactly on the diagonal. Both fitted families capture this central positive association reasonably well. The Gumbel copula is substantively attractive when joint high rainfall and high runoff are the principal scientific concern because it permits upper-tail dependence. Moreover, for this sample its maximized pseudo-log-likelihood, is slightly larger than that of the Gaussian copula, Thus the Gumbel copula is the preferred model among these two fitted families on this descriptive criterion. Nevertheless, with only observations, the data provide limited information in the extreme upper-right corner of the unit square. The preference for Gumbel should therefore be interpreted cautiously and not as conclusive evidence of asymptotic upper-tail dependence.
- (i)
-
For , the fitted-copula estimates are and Both are substantially greater than the independence benchmark The Gumbel copula gives the larger estimated probability of coincident high rainfall and high runoff. Its distinction from the Gaussian copula becomes still more consequential when extrapolating to more extreme thresholds, because it has positive upper-tail dependence whereas the Gaussian copula is asymptotically tail independent.
Mathematica code snippets. The code below reproduces the calculations. It is written using elementary built-in functions. Numerical optimization is restricted to the interior of the parameter spaces because the copula densities are singular or problematic at the boundaries.
(* --------------------------------------------------------------- *)
(* 1. Data, scatterplots, ranks, and pseudo-observations *)
(* --------------------------------------------------------------- *)
data = {
{34.7, 64.1}, {26.8, 19.1}, {42.1, 71.1}, {12.9, 27.3},
{20.1, 24.8}, {73.5, 88.3}, {111.9, 119.3}, {15.7, 26.9},
{14.0, 10.6}, {37.9, 58.3}, {114.2, 105.0}, {15.5, 17.5},
{14.5, 21.5}, {33.3, 42.0}, {21.1, 13.1}, {38.1, 45.6},
{20.3, 41.3}, {19.1, 22.8}, {45.6, 39.2}, {23.8, 22.9},
{35.6, 58.1}, {50.8, 20.3}, {97.4, 87.7}, {57.2, 117.8},
{34.0, 17.2}, {16.9, 33.9}, {13.1, 11.5}, {27.6, 17.4},
{40.3, 110.0}, {33.6, 42.5}
};
{x, y} = Transpose[data];
n = Length[data];
ListPlot[data, Frame -> True, PlotRange -> All,
FrameLabel -> {"rainfall (mm)", "runoff (10^3 m^3)"},
PlotStyle -> Directive[Blue, PointSize[0.016]]]
(* Because there are no ties, Ordering[Ordering[...]] gives ranks. *)
rX = Ordering[Ordering[x]];
rY = Ordering[Ordering[y]];
u = N[rX/(n + 1)];
v = N[rY/(n + 1)];
uv = Transpose[{u, v}];
ListPlot[uv, Frame -> True, AspectRatio -> 1,
FrameLabel -> {"u", "v"}, PlotRange -> {{0, 1}, {0, 1}},
PlotStyle -> Directive[Red, PointSize[0.016]]]
(* --------------------------------------------------------------- *)
(* 2. Pearson correlation, Spearman rho, and Kendall tau *)
(* --------------------------------------------------------------- *)
rPearson = Correlation[x, y];
(* Spearman rho, valid because there are no ties. *)
rhoSHat = 1 - 6 Total[(rX - rY)^2]/(n (n^2 - 1));
(* Kendall tau: concordant minus discordant pairs, divided by n choose 2. *)
pairs = Subsets[Range[n], {2}];
tauHat = Total[Sign[(x[[#[[1]]]] - x[[#[[2]]]])*
(y[[#[[1]]]] - y[[#[[2]]]])] & /@ pairs]/Binomial[n, 2];
N[{rPearson, tauHat, rhoSHat}]
(* {0.794774, 0.554023, 0.733927} *)
(* --------------------------------------------------------------- *)
(* 3. Empirical copula and inversion of Kendall's tau *)
(* --------------------------------------------------------------- *)
empCopula[a_?NumericQ, b_?NumericQ] :=
Total[
Boole[#1 <= a && #2 <= b] & @@@ Transpose[{u, v}]
]/n;
N[empCopula @@@ {{.5, .5}, {.8, .8}, {.9, .9}}]
(* {0.433333, 0.766667, 0.833333} *)
rhoTau = Sin[Pi tauHat/2];
thetaTau = 1/(1 - tauHat);
N[{rhoTau, thetaTau}]
(* {0.764495, 2.24227} *)
(* --------------------------------------------------------------- *)
(* 4. Copula densities and maximum pseudolikelihood *)
(* --------------------------------------------------------------- *)
gaussianDensity[uu_?NumericQ, vv_?NumericQ, rho_?NumericQ] :=
Module[{a, b},
a = InverseCDF[NormalDistribution[], uu];
b = InverseCDF[NormalDistribution[], vv];
Exp[(2 rho a b - rho^2 (a^2 + b^2))/(2 (1 - rho^2))]/
Sqrt[1 - rho^2]
];
gumbelDensity[uu_?NumericQ, vv_?NumericQ, theta_?NumericQ] :=
Module[{a, b, s, t},
a = -Log[uu];
b = -Log[vv];
s = a^theta + b^theta;
t = s^(1/theta);
Exp[-t] (a b)^(theta - 1) s^(1/theta - 2) (t + theta - 1)/(uu vv)
];
logLikGaussian[rho_?NumericQ] :=
Total[Log[gaussianDensity[#[[1]], #[[2]], rho]] & /@ uv];
logLikGumbel[theta_?NumericQ] :=
Total[Log[gumbelDensity[#[[1]], #[[2]], theta]] & /@ uv];
fitGaussian = FindMaximum[
{logLikGaussian[rho], -.999 < rho < .999}, {rho, rhoTau}];
fitGumbel = FindMaximum[
{logLikGumbel[theta], 1.000001 < theta < 20}, {theta, thetaTau}];
N[{fitGaussian, fitGumbel}]
(* {{11.4359, {rho -> 0.770723}},
{12.1508, {theta -> 2.24462}}} *)
(* --------------------------------------------------------------- *)
(* 5. Tail dependence and fitted joint exceedance probability *)
(* --------------------------------------------------------------- *)
rhoMPL = rho /. Last[fitGaussian];
thetaMPL = theta /. Last[fitGumbel];
lambdaLGaussian = 0;
lambdaUGaussian = 0;
lambdaLGumbel = 0;
lambdaUGumbel = 2 - 2^(1/thetaMPL);
N[lambdaUGumbel]
(* 0.638205 *)
gaussianCopula[q_?NumericQ, rho_?NumericQ] := CDF[
MultinormalDistribution[{0, 0}, {{1, rho}, {rho, 1}}],
{InverseCDF[NormalDistribution[], q],
InverseCDF[NormalDistribution[], q]}];
gumbelCopula[q_?NumericQ, theta_?NumericQ] :=
Exp[-(2 (-Log[q])^theta)^(1/theta)];
q = .90;
pGauss = 1 - 2 q + gaussianCopula[q, rhoMPL];
pGumbel = 1 - 2 q + gumbelCopula[q, thetaMPL];
N[{pGauss, pGumbel}]
(* {0.053241, 0.0663387} *)
Note that the population data-generating mechanism used to create this teaching sample was a Gumbel copula with , for which and , combined with lognormal margins. The realized sample need not reproduce the generating parameter exactly; in fact, its moderate size is useful for illustrating sampling variation and the limits of tail-dependence inference from a small dataset.
References
- Casella, G., & Berger, R. L. (2002). Statistical inference (2nd ed.). Duxbury.
- Genest, C., & Favre, A.-C. (2007). Everything You Always Wanted to Know about Copula Modeling but Were Afraid to Ask. Journal of Hydrologic Engineering, 12(4), 347–368. https://doi.org/10.1061/(asce)1084-0699(2007)12:4(347)
- Joe, H. (1997). Multivariate Models and Multivariate Dependence Concepts. Chapman and Hall/CRC. https://doi.org/10.1201/9780367803896
- Nelsen, R. B. (1999). An Introduction to Copulas. In Lecture Notes in Statistics. Springer New York. https://doi.org/10.1007/978-1-4757-3076-0
- Salmon, F. (2009). Recipe for disaster: The formula that killed wall street. Wired, 17(3).
- Sklar, A. (1959). Fonctions de répartition à n dimensions et leurs marges. Publications de l’Institut de Statistique de l’Université de Paris, 8, 229–231.
Cite this article
Müller, W. (2026). An Introduction to Copulas: a Complement. Journal of Reproducible Statistics, 1, 2. https://doi.org/10.68365/jrepstat.2026.2
Müller, Werner. 2026. “An Introduction to Copulas: A Complement.” Journal of Reproducible Statistics 1: 2. https://doi.org/10.68365/jrepstat.2026.2.
Müller W. An Introduction to Copulas: a Complement. Journal of Reproducible Statistics. 2026;1:2. doi:10.68365/jrepstat.2026.2
Müller, W. (2026) “An Introduction to Copulas: a Complement,” Journal of Reproducible Statistics, 1, p. 2. Available at: https://doi.org/10.68365/jrepstat.2026.2.
doi: https://doi.org/10.68365/jrepstat.2026.2
Downloads
Once the Crossref deposit is live, https://doi.org/10.68365/jrepstat.2026.2 will also support content negotiation — these exports are served directly regardless.