Intertemporal Valuation using Multiplicative Functionals

8. Intertemporal Valuation using Multiplicative Functionals#

Download PDF here

Authors: Jaroslav Borovicka (NYU), Lars Peter Hansen (University of Chicago), and Thomas J. Sargent (NYU)

\(\newcommand{\eqdef}{\stackrel{\text{def}}{=}}\)

../_images/NavigatingUncertainty.jpg

Challenges in navigating long-term uncertainty.

“The greatest shortcoming of the human race is our inability to understand the exponential function.” – Albert A. Bartlett (Arithmetic, Population, and Energy, 1969)

“I think it’s much more interesting to live not knowing than to have answers which might be wrong. I have approximate answers and possible beliefs and different degrees of uncertainty about different things, but I am not absolutely sure of anything … . I don’t feel frightened not knowing things, by being lost in a mysterious universe without any purpose, which is the way it really is as far as I can tell.” — Richard P. Feynman

“Forecasts create the mirage that the future is knowable.” – Peter Bernstein

8.1. Introduction#

Chapter 4 described additive functionals of a Markov process. This chapter describes exponentials of additive functionals that we call multiplicative functionals. We can use them to model stochastic growth, stochastic discounting, belief distortions and their interactions. After adjusting for geometric growth or decay, a multiplicative functional contains a martingale component that turns out to be a likelihood ratio process that is itself a special type of multiplicative functional called an exponential martingale. By simply multiplying random variables of interest by the multiplicative martingale prior to computing conditional expectations under a baseline probability, we compute conditional expectations under an alternative probability measure. The exponential martingale thus functions as a relative density that converts the baseline probability measure into the alternative probability measure. For an early application of multiplicative functionals to asset valuation under preferences that express investors’ concerns about model misspecification, see [Anderson et al., 2003]. We will explore these and other applications in discussions that follow. We will see that multiplicative functionals have several applications. We shall use them to study consequences of stochastic growth and stochastic discounting that persist over long time horizons and how macroeconomic shocks can have long-term impacts on asset prices. They provide a tractable modeling tool for studying models in which investors have subjective beliefs that can be described in terms of discrepancies from a baseline probability in ways that can be measured with statistical discrimination measures. We will also describe other applications of multiplicative functionals, including models of returns and positive cash flows that compound over multiple horizons, and cumulative stochastic discount factors used to characterize long-horizon risk-return tradeoffs.

8.2. Geometric growth and decay#

To construct a multiplicative functional, we start with an underlying Markov process \(X\) that has a stationary distribution \(Q\), and we suppose that \(Y_0\) and \(X_0\) depend only on date zero information summarized by \({\mathfrak A}_0.\)

Definition 8.1

Let \(Y \eqdef \{ Y_t\}\) be an additive functional that as in Chapter 4 is described by

\[Y_{t+1} - Y_t = \kappa(X_t, W_{t+1}),\]

where \(X_t\) is the time \(t\) component of a Markov state vector satisfying \(X_{t+1} = \phi(X_t, W_{t+1})\) and \(W_{t+1}\) is the time \(t+1\) value of a martingale difference process (\({\mathbb E} \left(W_{t+1} \mid {\mathfrak A}_t \right) = 0 \)) of unanticipated shocks. We say that \(M \eqdef \{M_t: t \ge 0 \} = \{ \exp(Y_t) : t \ge 0 \}\) is a multiplicative functional parameterized by \(\kappa\).

An additive functional grows or decays linearly, so the exponential of an additive functional grows or decays geometrically. We construct a multiplicative functional recursively by

(8.1)#\[M_{t+1} = N_{t+1} M_t.\]

If we adopt the normalization that \(N_{t+1} =1\) if \(M_t =0\), we can solve for \(N_{t+1}\)

\[\begin{split}N_{t+1} = \left\{ \begin{array} { c c } \frac {M_{t+1}}{M_t}, & M_t > 0 \\ 1, & M_t = 0 \end{array} \right.\end{split}\]

In light of (8.1), we refer to \(N\) as the multiplicative increment of the process \(M\).

Chapter 1 stated a Law of Large Numbers for stationary processes and Chapter 3 a Central Limit Theorem for processes with stationary increments, both of which apply to the additive functionals that Chapter 4 decomposed. In this chapter, we use other mathematical tools to analyze the limiting behavior of multiplicative functionals.

8.3. Special multiplicative functionals#

We define three primitive multiplicative functionals.

Example 8.1

Suppose that \(\kappa = \eta\) is constant and that \(M_0\) is a Borel measurable function of \(X_0\). Then

\[M_t = \exp\left( t \eta \right)M_0.\]

This process grows or decays geometrically.

Example 8.2

Suppose that

\[{\mathbb E} \left[ \exp \left[ \kappa \left( X_t, W_{t+1} \right) \right] \mid {\mathfrak A}_t \right] = 1.\]

Then

(8.2)#\[{\mathbb E} \left(M_{t+1} \vert \mathfrak{A}_t \right) = M_t \]

so that

\[{\mathbb E} \left(N_{t+1} \vert \mathfrak{A}_t \right) = 1\]

A multiplicative functional that satisfies (8.2) is called a multiplicative martingale. We can view this process as a likelihood ratio process, and we relabel it \(L \eqdef M\). It will often be convenient to initialize this likelihood ratio process at \(M_0 = L_0 = 1.\)

Example 8.3

Suppose that \(M_t = \exp\left[f(X_t)\right]\) where \(f\) is a Borel measurable function. The associated additive functional satisfies

\[\begin{align*} Y_{t+1} - Y_t & = \log M_{t+1} - \log M_t \cr & = f(X_{t+1}) - f(X_t) \cr & = f\left[ \phi(X_t, W_{t+1} ) \right] - f(X_t) \end{align*}\]

and is parameterized by \(\kappa(X_t, W_{t+1}) = f\left[ \phi(X_t, W_{t+1} ) \right] - f(X_t)\) with initial condition \(Y_0 = f(X_0)\).

When the process \(\{X_t\}\) is stationary and ergodic, multiplicative functional Example 8.1 displays expected growth or decay, while multiplicative functionals Example 8.2 and Example 8.3 do not. Multiplicative functional Example 8.3 is stationary, while Example 8.1 and Example 8.2 are not.

By multiplying together instances of these primitive multiplicative functionals, we can construct other multiplicative functionals. We can also reverse that process by taking an arbitrary multiplicative functional and (multiplicatively) decomposing it into instances of our three types of multiplicative functionals. Before doing that, we explore multiplicative martingales in more depth.

8.4. Multiplicative martingales#

As we saw in Chapter 7, we can use multiplicative martingales to represent alternative probability models. In addition to capturing alternative probability models that a given decision maker entertains as possibilities, multiplicative martingales also provide a way to represent various models of subjective beliefs of private or government agents within dynamic, stochastic equilibrium models. Such a specification captures statistical departures from a baseline model that the model builder uses to describe the data.

We can characterize an alternative model with a set of implied conditional expectations of all bounded random variables, \(B_{t+1},\) that are measurable with respect to \({\mathfrak A}_{t+1}\). The constructed conditional expectation is

(8.3)#\[{\mathbb E} \left(N_{{t+1}} B_{{t+1}} \mid {\mathfrak A}_t \right) . \]

We want multiplication of \(B_{t+1}\) by \(N_{t+1}\) to change the baseline probability to an alternative probability model. To accomplish this, the random variable \(N_{t+1}\) must satisfy:

  1. \(N_{t+1} \ge 0\);

  2. \({\mathbb E}\left(N_{t+1} \mid {\mathfrak A}_t \right) = 1\);

  3. \(N_{t+1}\) is \({\mathfrak A}_{t+1}\) measurable.

Properties 1, 2, and 3 hold because \(N\) is the multiplicative increment of a multiplicative martingale: a multiplicative functional is positive, its increment has conditional expectation one, and \(M_{t+1}\) is \({\mathfrak A}_{t+1}\) measurable. Where

(8.4)#\[L_t = \prod_{j=1}^t N_{ j} ,\]

\(L \eqdef \{L_t : t=0, 1,...,\infty \}\) can be viewed as a likelihood ratio or Radon-Nikodym derivative process for the alternative probability measure relative to the baseline measure.

Representing an alternative probability model in this way is restrictive. For instance, if a nonnegative random variable has conditional expectation zero under the baseline probability, it will also have zero conditional expectation under the alternative probability measure, an indication that the implied probability measure is absolutely continuous with respect to the baseline measure. Two models that violate absolute continuity can be distinguished with probability one from finite samples alone. Likelihood-based statistical discrimination tests typically exclude such “easy to distinguish” alternatives by assuming mutually absolutely continuous alternative probability models.

Representation (8.4) implies that the implied alternative conditional probability measure over \(\tau\) periods can be represented in terms of the likelihood ratio

(8.5)#\[\frac {L_{t+\tau}}{L_t} = \prod_{j=1}^\tau N_{t + j} ,\]

which we can use to compute a \(\tau\) time-period-ahead conditional expectation. By using (8.5), we can compute a \(\tau\)-period conditional expectation by iterating on the one-period conditional expectations in accordance with the Law of Iterated Expectations.

As an alternative application, [Hansen and Scheinkman, 2009] show that multiplicative martingales also offer a way to value cumulative returns. Let \(R_t\) be a multiplicative process that measures a cumulative return between date \(t\) and date zero. Let \(S_t\) be a corresponding equilibrium discount factor between these same two dates. That \(M = RS\) is a multiplicative martingale follows from equilibrium restrictions on one-period returns. That is,

\[{\mathbb E} \left[ \left( \frac {S_{t+1}}{S_t} \right)\left( \frac {R_{t+1}}{R_t}\right) \mid {\mathfrak A}_t \right] = 1 , \]

where \(S_{t+1}/{S_t}\) is the one-period stochastic discount factor and \(R_{t+1}/{R_t}\) is the one-period gross return. For the application, we construct

\[N_{t+1} = \frac {S_{t+1} R_{t+1}}{S_t R_t}\]

Remark 8.1

Rational expectations imposes a communism of beliefs: every investor uses the model builder’s probabilities. Parts of the behavioral finance literature appeal to insights from psychology to motivate departures from that assumption. Our tools can help us interpret such models by leading us to think about sources of those model discrepancies in terms of the understandings and motivations that might lead a sophisticated investor to acknowledge possible discrepancies between a subjective model and the type of baseline approximating model commonly used in asset pricing models. Using martingales to represent belief distortions allows us to frame topics in the behavioral finance literature. For example, to be intelligible, papers about over-reactions or under-reactions must tell a reader with respect to what measure these reactions are to be judged to be mistakes. Our framework invites saying more about the martingale that accounts for those reactions. In some settings statistical divergence measures tell us that it is very difficult for sophisticated statisticians to distinguish or select among alternative approximating models as data descriptions. Investors’ belief distortions are likely to persist when statistical model-selection challenges confront both investors and the econometrician modeling them. We revisit these topics later in this chapter. See the discussions of rational expectations and of bounding investor beliefs.

Remark 8.2

These tools are also pertinent to the study of models in which investors have heterogeneous beliefs. [Alchian, 1950] and [Friedman, 1953], among others, have argued that investors with distorted beliefs will eventually be driven out of the market by investors with more accurate perceptions of the future because of the relative success of the latter type of investors. This has been one argument for imposing rational expectations in asset pricing models. [Kogan et al., 2006] refine this view by breaking a simple link between survival and price impact of the investors with distorted beliefs. [Borovička, 2020] goes further by characterizing families of investor preferences for which the investors with the distorted beliefs survive in the long run. These latter two contributions feature differences in how investors look at stochastic growth. A continuous-time counterpart to the martingale representation for belief distortions that we describe and characterize in this chapter is featured in both the [Kogan et al., 2006] and the [Borovička, 2020] papers.

Example 8.4

Fig. 8.1 uses a heterogeneous belief economy proposed by [Borovička, 2020] to study risk sharing. It plots the stationary densities for the fraction of aggregate consumption allocated to the first of two types of investors. The first consumer type is mistakenly optimistic about future consumption growth. The second knows the correct stochastic evolution. Both investors “survive” in the long run, and the allocation shifts in favor of the optimistic investor as both become more risk averse.

../_images/zeta1_density_stationary_by_gamma.png

Fig. 8.1 Stationary density for the fraction of output allocated to the mistakenly optimistic investor for alternative specifications of risk aversion. The risk aversion parameter is assumed to be the same for both investors; the slider varies it. Higher risk aversion shifts the allocation toward the optimistic investor.#

[Borovička, 2020] presumes that aggregate consumption is a Brownian motion with drift \(\mu = .02\) and conditional volatility \(\sigma = .02.\) The optimistic consumer presumes a drift of \({\tilde \mu} = .025\) and the same volatility. The martingale that allows us to rpresent the beliefs fo the optimistic consumer relative to the actual stochastic evolution is given by:

\[L_t = \exp\left[ \frac {{\tilde \mu} - \mu }{\sigma}(W_t - W_0) - \frac {t |{\tilde \mu} - \mu |^2} 2 \right]\]

where \(\{ W_t : t \ge 0 \}\) is a scalar Brownian motion. This figure endows each consumer with preferences for which the subjective rate of discount is \(.02,\) and the intertemporal elasticity of substitution is one. The preferences are formally posed and analyzed in Chapter 11.

8.5. Factoring a multiplicative functional#

Following [Hansen and Scheinkman, 2009] and [Hansen, 2012], we factor a multiplicative functional into three multiplicative components having the primitive types Example 8.1, Example 8.2, Example 8.3.

As in definition Definition 8.1, let \(Y\) be an additive functional, and let \(M = \exp(Y)\). Apply a one-period operator \(\mathbb{M}\) defined by

(8.6)#\[\begin{align} \mathbb{M}f(x) & \eqdef {\mathbb E}\left[ \exp(Y_{t+1} - Y_t) f(X_{t+1}) \mid X_t = x \right] \cr & = {\mathbb E}\left[ \left(\frac{M_{t+1}}{M_t} \right) f(X_{t+1}) \vert X_t = x \right] \end{align}\]

to bounded Borel measurable functions \(f\) of the Markov state. We recycle notation: Chapter 2 uses \({\mathbb M}\) for the resolvent operator \((1-\lambda)\sum_{j=0}^\infty \lambda^j {\mathbb T}^j\) that it deploys to characterize irreducibility. That operator and this one are unrelated. By applying the Law of Iterated Expectations, a two-period operator iterates \(\mathbb{M}\) twice to obtain:

(8.7)#\[\begin{align} \mathbb{M}^2 f(x) & \eqdef {\mathbb E} \left[ \exp(Y_{t+2} - Y_t) f(X_{t+2}) \mid X_t = x \right] \cr & = {\mathbb E}\left[ \left(\frac{M_{t+2}}{M_t} \right) f(X_{t+2}) \mid X_t = x \right], \end{align} \]

with corresponding definitions of \(j\)-period operators \(\mathbb{M}^j\). The family of operators is a special case of what is called a “semi-group.” The domain of the semigroup can typically be extended to a larger family of functions, but this extension depends on further properties of the multiplicative process used to construct it.

We next derive a revealing representation of this semigroup by factoring the multiplicative functional \(M\) in an interesting way. We achieve this by applying what is referred to in mathematics as Perron-Frobenius theory based on the following equation:

Eigenvalue-eigenfunction Problem: Solve

(8.8)#\[\mathbb{M}{\tilde e}(x) = \exp\left( {\tilde \eta} \right) {\tilde e}(x)\]

for an eigenvalue \(\exp(\tilde \eta)\) and a positive eigenfunction \({\tilde e}\).

Consistent with Perron-Frobenius theory, call the positive eigenvalue the principal eigenvalue, and the associated positive eigenvector the principal eigenfunction, of the operator \(\mathbb{M}\).

Use the principal eigenvalue and eigenvector, and define:

\[{\widetilde N}_{t+1} \eqdef \exp(- {\tilde \eta}) {\frac {M_{t+1}{\tilde e}(X_{t+1})}{M_t {\tilde e}(X_t)}} = \exp\left[{\tilde \kappa}(X_t, W_{t+1}) \right],\]

Note that we constructed \({\widetilde N}_{t+1}\) so as to have a conditional expectation equal to unity. Using \({\widetilde N}\) as a martingale increment process, build

\[{\widetilde L}_{t+1} = {\widetilde N}_{t+1} {\widetilde L}_t , \hspace{.3cm} {\widetilde L}_0 = 1. \]

Theorem 8.1

Let \(M\) be a multiplicative functional. Suppose that the principal eigenvalue-eigenfunction problem has a solution with principal eigenfunction \({\tilde e}(X)\). Then the multiplicative functional is the product of three components that are instances of the primitive functionals in examples Example 8.1, Example 8.2, and Example 8.3:

(8.9)#\[{\frac {M_t}{ M_0}} = \exp\left( {\tilde \eta} t \right) {\widetilde L}_t\left[ {\frac {{\tilde e}(X_0)}{{\tilde e}(X_t) }} \right]\]

where \({\widetilde L}_t\) is a multiplicative martingale with \({\widetilde L}_0 = 1\).

The factorization of a multiplicative functional described in Theorem 8.1 is a counterpart to the Chapter 4 Proposition 4.1 decomposition of an additive functional. We used the Proposition 4.1 martingale to identify the permanent component of an additive functional in Chapter 4. In this chapter, we shall use the multiplicative martingale isolated by Theorem 8.1 to represent a change of probability measure, one that will help us understand long-term risk-return tradeoffs. While \({\widetilde L}\) is a multiplicative martingale, \(\log {\widetilde L}\) is a supermartingale. There is a weaker connection between the two representations, however. Write the additive decomposition as:

\[\log M_t - \log M_0 = t {\hat \eta} + {\widehat L}_t + {\hat e}(X_0) - {\hat e}(X_t)\]

where \({\widehat L}\) is an additive martingale. As [Hansen, 2012] argues, if \({\widetilde L}\) is not degenerate (not equal to one), then \({\widehat L}\) is not degenerate (not equal to zero) and conversely.

Models in which \(X\) is a finite-state Markov chain give a direct computation in which the principal eigenvalue calculation reduces to finding an eigenvector of a matrix with all positive entries.

Example 8.5

The stochastic process \(X\) is governed by a finite-state Markov chain on state space \( \{ {\sf u}_1, {\sf u}_2, \ldots, {\sf u}_n \}\), where \({\sf u}_i\) is the \(n \times 1\) vector whose components are all zero except for \(1\) in the \(i^{th}\) row. The transition matrix is \({\mathbb P},\) where \({\sf p}_{ij} = \textrm{Prob}( X_{t+1} = {\sf u}_j | X_t = {\sf u}_i)\). We represent the Markov chain as

\[X_{t+1} = {\mathbb P}' X_t + W_{t+1}\]

where \({\mathbb E} (X_{t+1} | X_t ) = {\mathbb P}' X_t \), \({\mathbb P}'\) denotes the transpose of \({\mathbb P}\), and \(W_{t+1}\) is an \(n \times 1\) vector process that satisfies \({\mathbb E} ( W_{t+1} | X_t) = 0 \), which is therefore a martingale-difference sequence adapted to \(X_t, X_{t-1}, \ldots , X_0\). Think of \(W_{t+1}\) as the vector of errors when forecasting \(X_{t+1}\) based on current information.

Let \({\mathbb G}\) be an \(n \times n\) matrix whose \((i,j)\) entry \({\sf g}_{ij}\) is an additive contribution to the growth that \(Y_{t+1} - Y_t\) experiences when \(X_{t+1} = {\sf u}_j\) and \(X_t = {\sf u}_i\). The stochastic process \(Y\) is governed by the additive functional

\[Y_{t+1} - Y_t = (X_t)'{\mathbb G} X_{t+1} = (X_t)' {\mathbb G} {\mathbb P}' X_t + (X_t)' {\mathbb G} W_{t+1}\]

Let \(M= \exp(Y)\). Define a matrix \({\mathbb M}\) whose \((i,j)^{th}\) element is \({\sf m}_{ij} = \exp({\sf g}_{ij}).\) Represent the stochastic process \(M\) as the multiplicative functional:

(8.10)#\[{\frac {M_{t+1}}{M_t}} = \exp\left[ (X_t)' {\mathbb G} X_{t+1} \right] = (X_t)'{\mathbb M} X_{t+1}.\]

Associated with this multiplicative functional is the principal eigenvalue problem

\[{\mathbb E} \left[ {\frac {M_{t+1}}{M_t}} \tilde e \cdot X_{t+1} | X_t = x \right] = \exp\left( \tilde \eta \right) \tilde e \cdot x.\]

To convert this to a linear algebra problem, write the \(j^{th}\) entry of \({\tilde e}\) as \({\tilde e}_j\). Since \(X_t\) always assumes the value of one of the coordinate vectors \({\sf u}_i, i =1, \ldots, n\),

\[(X_t)'{\mathbb M} X_{t+1} = {\sf m}_{ij}\]

when \(X_t = {\sf u}_i\) and \(X_{t+1} = {\sf u}_j\). This allows us to rewrite the principal eigenvalue problem as

\[\sum_j {\sf p}_{ij} {\sf m}_{ij} \tilde e_j = \exp(\tilde \eta) \tilde {e}_i\]

or

(8.11)#\[\widetilde {\mathbb M} \tilde e = \exp(\tilde \eta) \tilde e\]

where \(\widetilde {\sf m}_{ij} \eqdef {\sf p}_{ij} {\sf m}_{ij}\) and \({\tilde e}_i\) is entry \(i\) of \({\tilde e}\).

Notice that this construction incorporates the transition probabilities into the construction of the matrix \({\widetilde {\mathbb M}}\). We do this to reduce the problem to one of finding an eigenvalue and corresponding eigenvector of a matrix. Specifically, we want the positive eigenvalue associated with a positive eigenvector of (8.11).

After solving the principal eigenvalue problem, we construct an alternative transition matrix for a finite-state Markov process. Construct

(8.12)#\[{\widehat {\sf n}}_{ij} = \exp\left( - \tilde \eta \right) {\widetilde {\sf m}}_{ij} \frac {{\tilde e}_j}{{\tilde e}_i} ,\]

and form the matrix \({\widehat {\mathbb N}} = [{\widehat {\sf n}}_{ij}]\). The matrix \({\widehat {\mathbb N}}\) has entries that are nonnegative, and

\[\sum_{j=1}^n {\widehat {\sf n}}_{ij} = 1, \]

which verifies that \({\widehat {\mathbb N}}\) can be viewed as a transition matrix.

Finally, we show how to construct the factorization of the \(M\) process. To build the martingale of interest, we must undo the probability scaling that we did when forming \({\widehat {\mathbb N}}.\) With this in mind, solve for \({\tilde n}_{ij}\) that satisfies:

\[{\widehat {\sf n}}_{ij} = {\widetilde {\sf n}}_{ij}{\sf p}_{ij},\]

where we arbitrarily set \({\widetilde {\sf n}}_{ij}\) equal to one when \({\sf p}_{ij} = 0\) and build the matrix \({\widetilde {\mathbb N}} = [ {\widetilde {\sf n}}_{ij}]\). These constructions allow us to write (8.10) as

(8.13)#\[{\frac {M_{t+1}}{M_t}} = \exp\left( \tilde \eta \right) \left[(X_t)'{\widetilde {\mathbb N}} X_{t+1}\right] \left( \frac {{\tilde e} \cdot X_t }{{\tilde e} \cdot X_{t+1}} \right) .\]

Remark 8.3

In the previous example, suppose that \({M_{t+1}}/{M_t} \) is a one-period stochastic discount factor used to represent asset prices via a formula:

\[{\mathbb E}\left[ \left(\frac{M_{t+1}}{M_t}\right) \left(\frac{G_{t+1}}{G_t}\right) \mid X_t \right]\]

for alternative one-period asset payoffs \({G_{t+1}}/{G_t}\) that are constructed in terms of \(X_{t+1}\) and \(X_t\). In the previous construction, the matrix \(\widetilde {\mathbb M}\) could be inferred from prices of one-period-ahead Arrow securities. Specifically, given prices of all of the state contingent claims for next period, we can infer the row of \(\widetilde {\mathbb M}\) associated with a given current state. By looking across states, we can fill out all of the rows of \(\widetilde {\mathbb M}\). We only need to know \(\widetilde {\mathbb M}\) to pose and solve the principal eigenvalue problem and hence to construct transition probabilities as given by (8.12), but not the \({\sf p}_{ij}\)’s and the \({\sf m}_{ij}\)’s. This provides a challenge for recovering transition probabilities from asset prices. The \({\sf p}_{ij}\)’s and \({\sf m}_{ij}\)’s cannot be inferred uniquely from the \({\widetilde {\sf m}}_{ij}\)’s. In particular, the Arrow prices are insufficient to identify the transition probabilities. [Ross, 2015] imposed additional restrictions on \({\widetilde{\sf m}}_{ij}\)’s that implied that the recovered probabilities are actually the \({\sf p}_{ij}\)’s. In general, the recovered probabilities will differ from the baseline transition probability matrix because these restrictions fail to be satisfied. We will have more to say about this difference and investigate why the recovered probabilities remain interesting. See [Borovička et al., 2016] for an extended discussion of this claim.

8.6. More examples#

We first use a log-linear, log-normal specification displays the mechanics of the multiplicative factorization and its connection to the corresponding additive decomposition.

Example 8.6

Consider a stationary \(X\) process and an additive \(Y\) process described by the VAR

\[\begin{align*} X_{t+1} & = {\mathbb A} X_t + {\mathbb B} W_{t+1} \cr Y_{t+1} - Y_t & = \nu + {\mathbb D} X_t + {\mathbb F} W_{t+1} \end{align*}\]

where \({\mathbb A}\) is a stable matrix and \(\{ W_{t+1} : t \ge 0 \}\) is a sequence of independent and identically distributed normal random vectors with mean zero and covariance matrix \({\mathbb I}\). Let \(M_t = \exp(Y_t)\). Use equation (8.15) to deduce

\[\frac{M_t}{M_0} = \exp\left( \tilde \eta t \right) {\widetilde L}_t \left[ \frac{\tilde e (X_0)} {\tilde e(X_t)} \right]\]

where

\[\tilde \eta = \nu + \frac {\mid {\mathbb H} \mid^{2}} 2 ,\]
(8.14)#\[\widetilde N_{t+1} = \exp \left( {\mathbb H}W_{t+1} -\frac{ \mid {\mathbb H} \mid^2 }{2} \right), \quad \widetilde L_0 =1 ,\]

and

\[\tilde e(x) = \exp[g(x)] = \exp \left[ {\mathbb D} \left({\mathbb I} - {\mathbb A} \right)^{-1} x \right] .\]

In Proposition 4.1 of Chapter 4, we described the decomposition

(8.15)#\[Y_{t} - Y_0 = t \nu + \left[\sum_{j=1}^{t} {\mathbb H} W_{j}\right] - g(X_{t}) + g(X_0)\]

where

\[\begin{align*} {\mathbb H} = & {\mathbb F} + {\mathbb D}\left({\mathbb I} - {\mathbb A} \right)^{-1} {\mathbb B} \cr g(x) = & {\mathbb D}\left({\mathbb I} - {\mathbb A}\right)^{-1} x. \end{align*}\]

Example 8.7

Consider the following stochastic volatility example. Suppose that a scalar state variable evolves as a first-order autoregression:

\[\begin{align} X_{t+1} & = {\sf a} X_t + {\sf b}W_{t+1} \cr Y_{t+1} - Y_t & = \nu + \left({\sf f}_0 + {\sf f}_1 X_t \right)W_{t+1} \end{align}\]

where \(\{W_{t+1} : t \ge 0 \}\) is an i.i.d. sequence of normally distributed random variables. The state variable \(X_t\) gives the source of volatility fluctuations. Guess a principal eigenfunction of the form:

\[{\tilde e}(x) = \exp\left( \epsilon_1 x + \frac {\epsilon_2} 2 x^2 \right),\]

and construct

\[e^-(x, w) \eqdef \epsilon_1 {\sf a } x + \epsilon_1 {\sf b} w + \frac {\epsilon_2} 2 {\sf a}^2 x^2 + \epsilon_2 {\sf a} {\sf b}xw + \frac {\epsilon_2} 2 {\sf b}^2 w^2.\]

Write the principal eigenfunction equation as:

\[\begin{align} &\log {\mathbb E}\left( \exp\left[\nu + \left({\sf f}_0 + {\sf f}_1 X_t \right) W_{t+1} + {e}^-\left(X_t, W_{t+1}\right) \right] \mid X_t = x \right) \cr & \hspace{1cm} = {\tilde \eta}+ \epsilon_1 x + \frac {\epsilon_2} 2 x^2, \end{align}\]

where we took logarithms of both sides of the equation. The computation on left side of this equation has a tractable formula for expressing the outcome as a quadratic function of the state.

Solve the equation in three steps. First, equate coefficients on \(x^2\) and deduce a quadratic equation for \(\epsilon_2.\) Next, equate the coefficient on \(x\) and obtain a linear equation for \(\epsilon_1\). Finally, equating the constant terms to obtain an equation for \({\tilde \eta}\). The initial quadratic equation is

\[ {\sf b}^2 (\epsilon_2)^2 + \left({\sf a}^2 + 2 {\sf f}_1{\sf a}{\sf b} - 1 \right) \epsilon_2 + \left({\sf f}_1\right)^2 = 0.\]

When it has a solution, there will typically be two possible choices. For the solution to be of interest, \(1 - \epsilon_2 {\sf b}^2\) must be positive.

Second, equate the coefficient on \(x\) to solve an equation for \(\epsilon_1\) given \(\epsilon_2\):

\[\left( {\sf f}_1 + \epsilon_2 {\sf a}{\sf b} \right) \left( {\sf f}_0 + \epsilon_1 {\sf b} \right) + \epsilon_1 ({\sf a} - 1) \left(1 - \epsilon_2 {\sf b}^2\right) = 0. \]

Third, we solve for \({\tilde \eta}\) by equating the constant and plugging the solutions for \(\epsilon_1\) and \(\epsilon_2\):

\[\tilde{\eta} = \frac { \left({\sf f}_0 + \epsilon _1 {\sf b} \right)^2 } { 2(1 - \epsilon_2 {\sf b}^2 )} - \frac 1 2 \log \left( 1 - \epsilon_2 {\sf b}^2 \right) + \nu. \]

For this example,

\[{\widetilde N}_{t+1} \propto \exp\left[ \left({\sf f}_0 + {\sf f}_1 X_t\right) W_{t+1} + \epsilon_1 {\sf b} W_{t+1} + {\frac {\epsilon_2} 2} {\sf b}^2 \left(W_{t+1}\right)^2 + \epsilon_2 {\sf a}{\sf b} X_t W_{t+1} \right]\]

where \(\propto\) means equal up to a scale factor that depends on \(X_t\). Under the implied change in measure, \(W_{t+1}\) is distributed as a normal random variable with conditional mean

\[\frac {{\sf f}_0 + {\sf f}_1 X_t + \epsilon_1 {\sf b} + \epsilon_2 {\sf a}{\sf b} X_t}{1 - \epsilon_2 {\sf b}^2 }\]

and precision \(1 - \epsilon_2 {\sf b}^2\). Under the change of probability measure, \(W_{t+1}\) remains normally distributed, with a different variance and a state-dependent mean, and \(X\) remains a first-order autoregression with different dynamics. It could, for instance, be an explosive autoregression.

The additive martingale of \(Y= \log(M)\) has a variance that grows linearly over time. That variance contributes a component to the exponential trend of the multiplicative functional \(M\), along with a simple time-horizon adjustment to the martingale component.

Remark 8.4

The martingale component of the multiplicative functional has “peculiar behavior.” It has expectation one by construction. The Martingale Convergence Theorem guarantees that sample paths converge, typically to zero. This theorem is operative because the positive martingale is bounded from below. Since its date zero conditional expectation is one, for long horizons this process necessarily has a fat right tail. Fig. 8.2 plots probability density functions of the martingale component for different values of \(t\).

../_images/Lt_pdf.png

Fig. 8.2 Density of \(\widetilde{L}_t\) for different values of \(t\).#

Fig. 8.3 displays many simulated paths of \({\widetilde L}_t\) over a long horizon. The theoretical mean, marked by the dash-dotted line, stays pinned at one, yet almost every path drifts toward zero; the unit mean is preserved only by an ever thinner set of paths that take ever larger values.

Although \(E_0 {\widetilde L}_t = 1\) for every \(t\), its sample paths converge to zero almost surely. Fig. 8.3 displays many simulated paths of \({\widetilde L}_t\) over a long horizon. The theoretical mean, marked by the dash-dotted line, stays pinned at one, yet almost every path drifts toward zero; the unit mean is preserved only by an ever thinner set of paths that take ever larger values.

../_images/addfunc_peculiar.png

Fig. 8.3 The peculiar property of the multiplicative martingale \(\widetilde L_t\): its conditional mean is \(E_0\widetilde L_t = 1\) for all \(t\) (dash-dotted line), yet almost every path converges to zero as \(t\) grows. The permanent-component loading is held at the chapter’s calibration, \(|\mathbb{H}| = .05\), so that \(a_t = t|\mathbb{H}|^2\); drag paths to change how many trajectories are shown.#

The Gaussian structure in Example 8.6 makes the mechanism transparent. Because

\[\log {\widetilde L}_t = \sum_{j=1}^t \left( {\mathbb H} W_j - \frac{|{\mathbb H}|^2}{2} \right) \sim {\mathcal N}\left( - t \, t |{\mathbb H}|^2 \right),,\]

\({\widetilde L}_t\) is log normal. The downward drift in mean of \(\log {\widetilde L}\) is offset but the upward drift of the variance in order that the expection remain equal to one. The median value

\[- \frac{t |{\mathbb H}|^2}{2} \]

collapses to zero. As with the variance, both the skewness and kurtosis diverge.

Consider the behavior of cumulative returns over long horizons. Since \(SR\) is a positive martingale, as illustrated by Fig. 8.2, it becomes increasingly important that the process has excursions for which it becomes large as we extend the horizon. This is the setting for the [Martin, 2012] argument about fat tails in scaled cumulative returns.

While the multiplicative martingale has peculiar sample path properties, we are primarily interested in this martingale component as a change of probability measure. For instance, in Example 8.6, formula (8.14) for \({\widetilde N}_{t+1}\) tells how the change in probability measure induces mean \( {\mathbb H}\) in the conditional distribution for the shock \(W_{t+1}\). Similarly, \({\widetilde {\mathbb N}},\) with entries given in formula (8.12), provides an alternative transition matrix in Example 8.5.

8.7. Stochastic stability#

Our characterization of a change of probability measure as the solution of a Perron-Frobenius problem determines only transition probabilities. Since the process is Markov, it is of interest to seek an initial distribution of \(X_0\) under which the process is stationary and satisfies a stochastic stability property that we will define and explore. Stochastic stability opens the door to the study of a variety of limiting behavior and hence justifies our interest in the multiplicative factorization. The eigenfunction problem can have multiple solutions; it turns out, however, that there is a unique solution for which the process \(X\) is stochastically stable under the implied change of measure. See [Hansen and Scheinkman, 2009] and [Hansen, 2012] for formal analyses of this problem in a continuous-time Markov setting. In what follows we investigate the discrete-time counterpart to their investigations.

Definition 8.2

A process \(X\) is stochastically stable under a probability measure \({\widetilde {Pr}}\) if it is stationary and \(\lim_{j \rightarrow \infty} {\widetilde {\mathbb E}} \left[f(X_j) \mid X_0 = x \right] = {\widetilde {\mathbb E}} \left[ f(X_0) \right]\) for any Borel measurable \(f\) satisfying \({\widetilde {\mathbb E}} \vert f(X_t) \vert < \infty\).

As we discussed previously, a multiplicative martingale \(L\) with \(L_0 =1\) induces a probability measure conditioned on \(X_0.\) To check for stochastic stability, we extend the probability by including a distribution over \(X_0\) in a manner that ensures the process \(X\) is stationary.

Remark 8.5

Notice that the stationary probability distribution for \(X_t\) implied by \(\widetilde {Pr}\) is used to define the limits of the conditional expectations. For the mathematical results, however, how we initialize the distribution over \(X_0\) is not crucial. Thus, we could equivalently consider other probability measures under which \(X_t\) has the same limiting distribution as \(t\) gets large. Under such probability measures, the process \(X\) would be asymptotically stationary. In this sense, we impose the stronger stationarity restriction as a matter of convenience.

Theorem 8.2

Let \(M\) be a multiplicative functional. Suppose that \((\tilde \eta, \tilde e)\) solves the eigenfunction problem and that under the change of measure \(\widetilde{Pr}\) implied by the associated martingale \(\widetilde L\) the stochastic process \(X\) is stationary and ergodic. Consider any other solution \((\eta^*, e^*)\) to eigenfunction problem with implied martingale \(\{ L_t^* \}\). Then

  1. \(\eta^* \ge \tilde \eta\).

  2. If \(X\) is stochastically stable under the change of measure \(Pr^*\) implied by the martingale \(L^*\), then \(\eta^* = \tilde \eta\), \(e^*\) is proportional to \(\tilde e\), and \(L^*_t = \widetilde L_t\) for all \(t=0,1,... \).

Proof. First we show that \(\eta^* \ge \tilde \eta\). Write:

\[ \mathbb{M}^t{e^*}(x) = \exp\left( \tilde \eta t \right) \widetilde{\mathbb E} \left( \left[ \frac { \tilde e(X_0)}{\tilde e(X_t) } \right] {e^*}(X_t) \Biggl| X_0=x \right) = \exp \left( \eta^* t \right) e^*(x) . \]

Thus,

\[ \widetilde{\mathbb E} \left( \left[ \frac { e^*(X_t)}{\tilde e(X_t) } \right] \Biggl| X_0=x \right) = \exp \left( \eta^* t - \tilde \eta t \right) \left[ \frac {e^*(x)}{\tilde e(x)} \right] . \]

If \(\tilde \eta > \eta^*\), then

\[ \lim_{t \rightarrow \infty} \widetilde{\mathbb E} \left( \left[ \frac { e^*(X_t)}{\tilde e(X_t) } \right] \Biggl| X_0=x \right) = 0. \]

But this equality cannot be true because under \(\widetilde{Pr},\) \(X\) is stochastically stable and \(\frac {e^*}{\tilde e}\) is strictly positive. Therefore, \(\eta^* \ge {\tilde \eta}.\)

Consider next the case in which \(\eta^* > \tilde \eta\). Write

\[ \frac {M_t}{ M_0} = \exp\left( \eta^* t \right) \left( \frac { L^*_t}{ L^*_0 } \right) \left( \frac {e^*(X_0)}{e^*(X_t) } \right), \]

which implies that

\[ \mathbb{M}^t\tilde e(x) = \exp\left( \eta^* t \right) E^* \left[ \left( \frac {e^*(X_0)}{e^*(X_t) } \right) \tilde e(X_t) \Biggl| X_0=x \right] = \exp \left( \tilde \eta t \right) \tilde e(x) . \]

Thus,

\[ {\mathbb E}^* \left( \left[ \frac { \tilde e(X_t)}{e^*(X_t) } \right] \Biggl| X_0=x \right) = \exp\left( \tilde \eta t - \eta^* t \right)\left[ \frac {\tilde e(x)}{e^*(x)}\right]. \]

If \(\tilde \eta < \eta^*\), then

\[ \lim_{t \rightarrow \infty} {\mathbb E}^* \left( \left[ \frac { \tilde e(X_t)}{e^*(X_t) } \right] \Biggl| X_0=x \right) = 0 , \]

so that \(X\) cannot be stochastically stable under the \(Pr^*\) measure.

Finally, suppose that \(\tilde \eta = \eta^*\) and that \(\frac {\tilde e(x)}{e^*(x)}\) is not constant. Then

\[ {\mathbb E}^* \left( \left[ \frac { \tilde e(X_t)}{e^*(X_t) } \right] \Biggl| X_0=x \right) = \frac {\tilde e(x)}{e^*(x)} \]

and \(X\) cannot be stochastically stable under the \(Pr^*\) measure.

Stochastic stability under the martingale-induced change of measure provides a way to frame some interesting long-term approximations. Let

(8.16)#\[{\mathcal F}({\widetilde L}) \eqdef \left\{ f > 0 : \widetilde {\mathbb E} \left[ f(X_t) \right] < \infty \right\}\]

where \({\widetilde L}\) is the martingale component in the factorization of \(M\). Construct the operator:

\[{\widetilde {\mathbb M}} f (x) \eqdef \exp\left( - {\tilde \eta} \right) \left[\frac 1 {{\tilde e}(x)} \right]{\mathbb M} {\tilde e} f (x) = \widetilde {\mathbb E}\left[ f(X_1) \mid X_0 = x \right] \]

where we have used the factorization of \(M\) to construct an alternative conditional expectation operator. Form the family (semi group) of operators:

\[{\widetilde {\mathbb M}}^j f (x) = \widetilde {\mathbb E}\left[ f(X_j) \mid X_0 = x \right] = \exp\left( - j {\tilde \eta} \right) \frac 1 {{\tilde e}(x)} {{\mathbb M}^j} \left({\tilde e} f\right) (x)\]

where we used the factorization given by Theorem 8.1 and the unique selection of such a representation Theorem 8.2 to obtain the right-side equality. Since \(X\) is stochastically stable under \(\widetilde{Pr}\),

(8.17)#\[\lim_{j \rightarrow \infty} {\frac 1 j} \log { {\mathbb M}}^j\left({\tilde e} f \right) (x) = {\tilde \eta} + \lim_{j \rightarrow \infty} \frac 1 j \log {\tilde e} + \lim_{j \rightarrow \infty} {\frac 1 j} \log {\widetilde {\mathbb E}} \left[ f(X_j) \mid X_0 = x \right] = {\tilde \eta}\]

for all \( \tilde e f\) provided that \(f \in {\mathcal F} ({\widetilde L} ).\) We use limit (8.17) to justify calling the Perron-Frobenius eigenvalue the long-term growth or decay rate of the multiplicative functional.

Under the stochastic stability restriction, we obtain a more refined approximation by adjusting for the growth or decay in the family of operators:

\[\begin{split} \lim_{j \rightarrow \infty} \exp (- {\tilde \eta} j ) {\mathbb M}^j \left({\tilde e}f\right) (x) & = \lim_{j \rightarrow \infty} {\widetilde {\mathbb E}} \left[ {f} (X_j) \Big| X_0 = x \right] {\tilde e}(x) \cr & = {\widetilde {\mathbb E}}\left[f (X_t)\right] \tilde e(x), \end{split}\]

where we assume that \(f\) is in \({\mathcal F}({\widetilde L})\). Thus once we adjust for the impact of \({\tilde \eta}\), the limiting function is proportional to \({\tilde e}\). The function \(f\) determines only a scale factor \({\widetilde {\mathbb E}}\left[f(X_t) \right]\).

We will apply the limiting results in a variety of ways in this and subsequent chapters. The multiplicative factorization can help us understand implications of stochastic equilibrium models for valuations of random payout processes. In addition, such factorizations can help organize empirical evidence in ways that make contact with such stochastic equilibrium asset pricing models. We also use these tools to calculate Chernoff entropy as introduced in Chapter 7. Worked computations of these entropies appear in the Appendix to Chapter 11 (A11.6).

8.8. Inferences about permanent shocks from asset prices#

Macroeconomists often study dynamic impacts of shocks to systems of variables measured in logarithms. For example, [Alvarez and Jermann, 2005] suggest looking at asset prices using a multiplicative representation of a cumulative stochastic discount factor, though without the tools provided by this chapter. The additive decomposition derived and analyzed in Chapter 4 is a convenient tool for identifying permanent shocks. A prominent multiplicative martingale component implies a prominent role for permanent shocks in the underlying economic dynamics. A formal probability model lets us link an additive decomposition as described in this chapter and Chapter 4 to the multiplicative factorization that we study in this chapter. Log normal models, at least as approximations, are often used by applied macroeconomists. Example 8.6 provides an example with explicit formulas linking the two representations. While distinct, the two martingales, in this special case, are closely linked. In general, the connection is more subtle. In what follows we describe how a multiplicative martingale component to a stochastic discount factor is reflected in asset prices.

Consider the following stochastic discount factorization

\[S_t = \exp( \eta^s t) L_t^s \left[\frac {e^s(X_0)}{e^s(X_t)} \right] \]

where \(S_0= L_0^s = 1.\) A date zero price of a long-term bond is:

\[{\mathbb E} \left( S_t \mid {\mathfrak A}_0 \right) = \exp(\eta^s t) \widetilde {\mathbb E} \left[ \frac {1}{e^s(X_t)} \Biggl| X_0 \right] e^s(X_0). \]

Compute the corresponding yield by taking \(1/t\) times minus the logarithm:

\[- \eta^s - {\frac 1 t} \log \widetilde {\mathbb E} \left[ \frac {1}{e^s(X_t)} \Biggl| X_0 \right] + \frac 1 t \log e^s(X_0).\]

Provided that

\[\widetilde {\mathbb E} \left[ \frac {1}{e^s(X_t)} \right] < \infty,\]

the limiting yield on a discount bond is \(- \eta^s.\)

Next consider a one-period holding period return on a \(t\) period discount bond:

\[\frac {\exp[\eta^s (t-1)] \widetilde {\mathbb E} \left[ \frac {1}{e^s(X_t)} \Biggl| X_1 \right] e^s(X_1)}{\exp(\eta^s t) \widetilde {\mathbb E} \left[ \frac {1}{e^s(X_t)} \Biggl| X_0 \right] e^s(X_0)}\]

Using stochastic stability and taking limits as \(t\) tends to \(\infty\) gives the limiting holding-period return:

(8.18)#\[R_1^{\infty} \eqdef \exp(-\eta^s) \frac{ e^s(X_1)} {e^s(X_0)} . \]

A simple calculation shows that \(R_1^{\infty}\) satisfies the following equilibrium pricing restriction on a one-period return:

\[{\mathbb E} \left[ \left(\frac {S_1}{S_0} \right) R_1^\infty \Biggl| {\mathfrak A}_0 \right] = {\widetilde {\mathbb E}} \left( \exp(\eta^s) \left[\frac{ e^s(X_0)} {e^s(X_1)} \right] \exp(-\eta^s) \left[\frac{ e^s(X_1)} {e^s(X_0)}\right] \Biggl| X_0 \right) = 1.\]

These long-horizon limits provide approximations to the eigenvalue for the stochastic discount factor and the ratio of the eigenfunctions.

In a model without a martingale component, [Kazemi, 1992] observed that the inverse of this holding-period return is the one-period stochastic discount factor; that is, within the [Kazemi, 1992] setup, \((R_1^\infty)^{-1}\) equals the one-period stochastic discount factor. Let \(Y_1\) be a vector of asset payoffs and \(Q_0\) be the corresponding vector of prices. Then standard asset pricing theory implies the conditional moment restrictions

(8.19)#\[{\mathbb E}\left( (R_1^\infty)^{-1} Y_1 \mid {\mathfrak A}_0 \right) = Q_0.\]

[Alvarez and Jermann, 2005] extend this insight by showing that the reciprocal reveals the component of the one-period stochastic discount factor net of its martingale component. To relate their insight to our previouis analysis and to open the door to measurement challenges, consider the generalization of (8.19):

(8.20)#\[{\mathbb E}\left( (R_1^\infty)^{-1} N_1 Y_1 \mid {\mathfrak A}_0 \right) = Q_0.\]

for \(N_1 \ge 0\) with \({\mathbb E}(N_1) = 1\). The random variable \(N_1\) reflects the multiplicative increment to a postive martingale. Formula (8.20) is typically not sufficient to fully identify the increment, \(N_1.\) Later we will discuss ways to adddress this partial identification and to reveal information about its quantitative magnitude using asset market data.

Remark 8.6

In practice, we only have bond data with a finite payoff horizon, whereas the characterizations [Kazemi, 1992] and [Alvarez and Jermann, 2005] use bond prices with a limiting payoff horizon. Empirical implementations using such characterizations assume that the observed term structure data have a sufficiently long duration component to provide a plausible proxy for the limiting counterpart.

8.9. Digression on rational expectations#

Under a rational expectations assumption, a researcher equates the baseline probability measure with the one implied by the equilibrium of the model. The model of [Kazemi, 1992] provides an example. Kazemi’s underlying baseline model is Markov. Kazemi assumes that economic agents living inside his model are completely confident that they know those Markov dynamics. He thus adopts a rational expectations assumption. As noted by [Lucas, 1987] (p. 13)

The term ‘rational expectations’, as Muth used it, refers to a consistency axiom for economic models, so it can be given precise meaning only in the context of specific models. I think this is why attempts to define rational expectations in a model-free way tend to come out either vacuous (‘People do the best they can with the information they have’) or silly (‘People know the true structure of the world they live in’).

Once we add the assumption that our model-implied expectations actually generate the data we are studying, the rational expectations formulation of Muth and Lucas opens the door to a comprehensive econometric approach. Consider an econometrician who does not know some or all of the parameters of the underlying economic model and who proceeds to infer those parameters using formal statistical methods that have come to be called rational expectations econometrics. To elaborate, we call probabilities that are model-consistent in the sense of Muth and Lucas “model-implied probabilities”. These probabilities can in principle be expressed as a function of the model’s parameters. The outcome is typically a set of cross-equation restrictions that link formally the beliefs of the economic agents within the model to the data generation. Computing these restrictions involves solving a set of nonlinear equations that include Euler equations like the asset pricing equation (8.19) above as well as other equations that help determine the complete Markov dynamics. Being able to compute these functions is what opens the door to the application of formal statistical methods such as maximum likelihood. Importantly, this approach assumes that at least one of the members of the parameterized set of statistical models is consistent with the data generating process and that it is this data generation that the economic agents within the model use in their decision making. An application of rational expectations econometrics thus relies heavily on the economist’s model being complete in the sense of [Geweke, 2010]. [Sargent, 1978], [Saracoglu and Sargent, 1978], [Sargent, 1979], [Hansen and Sargent, 1980], [Wallis, 1980], [Hansen and Sargent, 2019] and other contributions in [Lucas and Sargent, 1981] present early applications of this complete-specification approach. [Hansen and Sargent, 2013], ch. 9 describes time-domain and frequency domain maximum likelihood estimation for a class of linear-quadratic-Gaussian dynamic stochastic general equilibrium models. These procedures are widely used throughout applied macro and monetary economics, due in part to the convenient software provided by [Adjemian et al., 2024] and [Herbst and Schorfheide, 2016].

[Hansen and Singleton, 1982] and [Hansen and Richard, 1987] suggest a different approach. They assume that an econometrician only has partial information and does not impose or fully parameterize the baseline probability model. Implicitly, they allow for the model components that are not fully parameterized to be revealed imperfectly (except in the infinite sample limit) to the econometrician by the actual data generating process. Thus, [Hansen and Singleton, 1982] and [Hansen and Richard, 1987] replace Muth’s consistency axiom operational in a fully specified econometric model with another notion of consistency that is implied by a Law of Large Numbers limit in a statistical setting that assumes that the process described by the baseline model is stationary and ergodic. Formally, this approach is implemented with a vector of conditional moment restrictions. [Hansen and Singleton, 1982] and [Hansen and Richard, 1987] thereby make possible a limited-information alternative to imposing rational expectations with a fully specified baseline model. Such an approach continues to adopt the simplification that economic agents, in contrast to an econometrician, know the underlying data generating process. Relieved of having to specify the full economic dynamic system, this limited information approach gains further flexibility by applying the law of iterated expectations to derive implications that the econometrician can use for estimation and testing. Applying such an approach in the context of the [Kazemi, 1992] setup converts the degenerate martingale restriction imposed by Kazemi into a moment restriction that accommodates estimation and statistical testing by using the generalized method of moments. See [Hansen, 1982].

Many published papers in the applied macro, industrial organization, and asset pricing literatures apply one of these two approaches. “Rational expectations econometrics” assumes that the econometrician knows a parameterized family of models that includes the rational expectations equilibrium, and that only the agents know the correct member of that family. The alternative approach assumes that the econometrician has only a partial a priori specification and leverages the Law of Large Numbers to fill in the rest.

The rational expectations econometrics assumptions that a correctly-specified model is among the parameterized family and that the economic agents inside the model know key parameters that the econometrician does not are heroic, to put it politely. Even Lucas’s statement above expresses skepticism when he dismisses the statement that ‘People know the true structure of the world they live in’ as being silly. Sophisticated applied economists acknowledge up front that their models are approximations, meaning that they are misspecified. Instead of formally integrating their concerns about possible misspecifications into statistical implementations, for reasons of tractability users of rational expectations econometrics routinely ignore such approximation concerns. For skeptics, the rational expectations econometrics straitjacket is simply too confining, leading them to adopt less formal methods of model matching and validation. Relatedly, without ever claiming or providing evidence that their model-implied expectations agree with an actual data generation process, many papers in applied theory routinely impose rational expectations in the process of constructing models of so-called stylized facts.

As we argued previously, a subjective belief specification is often expressible as a multiplicative martingale relative to a baseline probability specification, say the rational expectations counterpart or the probability that captures the actual data generation. Thus subjective beliefs offer one candidate for a multiplicative martingale component to the cumulative stochastic discount factor within the [Kazemi, 1992] setup. Statistical divergences provide a way to measure the magnitude of the belief-induced misspecification needed to capture empirical failures that arise from using one of the rational expectations econometrics approaches just described. This opens the door to using a statistical perspective to assess the role of subjective probabilities in models without rational expectations, in contrast to much of the existing research on subjective beliefs in asset pricing. See Bounding investor beliefs for an elaboration. To its credit, rational expectations provides a framework for conducting counterfactuals using an underlying dynamic economic model, along the lines of [Marschak, 1953] and [Hurwicz, 1966]. More general subjective belief formulations including ones represented by multiplicative martingales, unfortunately, struggle to do something comparable. Deciding when to use misspecified models and for what purposes is an important challenge for applied researchers.

8.10. Values of stochastic cash flows#

In a fundamental paper, [Rubinstein, 1976] featured the importance of cash-flow pricing in contrast to the often studied return-based analyses.

8.10.1. Long-term risk-return tradeoff for cash flows#

Following [Hansen and Scheinkman, 2009] and [Hansen et al., 2008], we consider the valuation of stochastic cash flows, \(G\), that are multiplicative functionals. Such cash flows are determinants of prices of both equities and bonds.

We now study valuation from the perspective of the long-term limits measured by the logarithms of the eigenvalues, the \(\tilde \eta\)’s, the long-term limits of prices of such cash flows. Consider a cash-flow growth process \(G\) measured as a multiplicative functional. The corresponding cash-flow return over horizon \(t\) is:

\[\frac {{G_t}}{ {\mathbb E} \left[ \ S_t G_t \mid {\mathfrak A}_0 \right] } = \frac {\frac {G_t}{G_0}} { {\mathbb E} \left( \frac {S_tG_t}{G_0} \Biggl| X_0 \right)} \]

where we have normalized \(S_0 = 1\). Note that as a special case, the cash-flow return on a unit date \(t\) cash-flow is:

\[\frac 1 {{\mathbb E} \left( S_t \mid X_0 \right)}\]

Define the proportional risk premium on the initial cash-flow return as the expected return divided by the riskless counterpart for the same horizon. Taking logarithms and adjusting for the time horizon gives:

(8.21)#\[\begin{split} & \frac 1 t \log {\mathbb E}\left( G_t \mid {\mathfrak A}_0 \right) - \frac 1 t \log {\mathbb E} \left( S_tG_t \mid \mathfrak A_0 \right) + \frac 1 t \log {\mathbb E}\left( S_t \mid {\mathfrak A}_0 \right) \cr & = \frac 1 t \left[ \log {\mathbb E}\left( \frac {G_t}{G_0} \Biggl| X_0 \right) + \log G_0\right] - \frac 1 t \left[ \log {\mathbb E} \left( \frac {S_tG_t}{G_0} \Biggl| X_0 \right) + \log G_0 \right] + \frac 1 t \log {\mathbb E}\left( S_t \mid X_0 \right) \cr & = \frac 1 t \log {\mathbb E}\left( \frac {G_t}{G_0} \Biggl| X_0 \right) - \frac 1 t \log {\mathbb E} \left( \frac {S_tG_t}{G_0} \Biggl| X_0 \right) + \frac 1 t \log {\mathbb E}\left( S_t \mid X_0 \right) \end{split}\]

where in the first expression, the first term is the logarithm of the expected payoff, the second term is minus the logarithm of the price, and the third term is minus the logarithm of the riskless cash-flow return for horizon \(t\). Scaling by \(1/t\) adjusts for the investment horizon.

The product \(SG\) is itself a multiplicative functional. Let \(\eta^{sg}\) denote its geometric growth component. Then from (8.21), the limiting cash-flow risk compensation is:

\[\eta^g + \eta^s - \eta^{sg} \]

This holds under the moment restrictions imposed in limit (8.17). The expression resembles the negative of a covariance as is often found in asset pricing, but it differs from a covariance because we are working with proportional measures of the risk compensations. When the cash flow process, \(G,\) is a cumulative return, the asset pricing restrictions inform us that \(SG\) is a martingale. In this case, the proportional risk premium is just:

\[\eta^g + \eta^s,\]

where, as we noted previously, \(- \eta^s\) is the long-term counterpart to a riskless rate of return.

8.10.2. Finite versus infinite-valued claims#

In a recent paper, [Panageas, 2025] reminds us that several important issues bear on finite values of claims to infinite cash flows, including macro processes like aggregate consumption and aggregate output. These issues include speculative bubbles, dynamic efficiency, and equity claims linked to macroeconomic outcomes. Importantly, he argues that the adjustment for uncertainty can play an important and sometimes subtle role in such evaluations.[1] We now explore in more detail when such valuations are finite taking account of uncertainty adjustments.

We start by building stochastic counterparts to the well known and pedagogically revealing Gordon growth model posed in discrete time. By using the framework developed in this chapter, we characterize the uncertainty adjustments necessary for such valuations. In so doing, we show how the tools of Black-Scholes option pricing must be altered to understand these valuations.

We build a multiplicative functional using the product, \(M = G S,\) where \(G\) captures stochastic growth in the cash flow and \(S\) stochastic discounting. The factorization in Theorem 8.1 and the selection we featured in Theorem 8.2 provide a defense for using \(\tilde \eta\) as an asymptotic growth or decay rate of \(M\) provided that we select the solution that is stochastically stable. To justify finite values of equity-based assets for a family of cash flows, we restrict \(\tilde \eta<0\) so that stochastic discounting dominates stochastic growth. We now revisit that analysis, deconstruct the outcome, and explore the limitations.

8.10.2.1. Constant discounting#

As a warm-up, consider a discrete-time Gordon growth model where:

\[\begin{split} S_t & = \exp(\eta_s t) \cr G_t & = \exp(\eta_g t) G_0 \end{split}\]

with \(\eta_s <0\) reflecting discounting and \(\eta_g\) capturing growth. The well known and simple to compute outcome gives:

\[\sum_{t=0}^\infty M_t = \frac 1 {1 - \exp(\eta_s + \eta_g)} G_0 ,\]

for \(M = SG\), provided that \({\tilde \eta} = { \eta}_s + {\eta}_g < 0\). Thus we have the familiar restriction that discounting has to dominate growth in a deterministic setting.

As is also well-known, the separation is not quite so simple because growth contributes to the rate of return used for discounting. The term \(\eta_s\) could reflect both subjective discounting in preferences and an adjustment contributed by economic growth in consumption that can either enhance or diminish the discount rate depending on investor preferences for intertemporal substitution.

8.10.2.2. Expected discounted cash flows#

Next consider discounted expected values for \(\tilde \eta < 0 \) and a stochastically stable Markov process \(X\). Recall that stochastic stability implies that conditional expectations converge to their unconditional counterpart. Thus we, temporarily, abstract from uncertainty adjustments in valuation not reflected in conditional expectations or encoded in the discount rate (We will be agnostic about how we come up with \(\tilde \eta\)). Consider the valuation of a positive claim on the Markov state, say \(f(X)\)

(8.22)#\[ \sum_{t=0}^\infty \exp({\tilde \eta} t) {\mathbb E} \left[ f(X_t) \mid X_0 = x \right]. \]

Under the presumed stochastic stability of the Markov process, two possibilities are of interest:

(8.23)#\[\begin{split} & {\mathbb E}\left[ f(X_t) \mid X_0 = x \right] \rightarrow {\mathbb E}\left[ f(X_t) \right] < \infty \cr & {\mathbb E}\left[ f(X_t) \mid X_0 = x \right] \uparrow {\mathbb E}\left[ f(X_t) \right] = + \infty . \end{split}\]

While it is common to feature the finite-moment case, here we proceed more generally. Except for the finite-state Markov case, we may easily construct payoffs that are positive functions of the Markov state that have infinite expectations. When the unconditional expectation is infinite, the value of the equity-type claim may or may not be finite. The expectation’s rate of divergence races the discount rate \(- {\tilde \eta}\). When the former grows faster than \(- {\tilde \eta},\) the valuation in (8.22) will be infinite, even though the underlying Markov process is stochastically stable.

Our more general approach required that we address a multiplicity that emerges when we factor \(M\). Take \(M_t = \exp\left( \tilde \eta t \right) \phi(X_t).\) For the sake of discussion, take \(S_t = \exp\left( \tilde \eta t\right)\), and \(G_t = \phi(X_t)\).
As a special case for such an \(M\) process, consider the solutions to the following equation:

\[{\mathbb E} \left[ {\hat e}(X_{t+1}) \mid X_t = x \right] = \exp\left( \hat \eta \right) {\hat e}(x).\]

Setting \({\hat e} = 1\) and \({\hat \eta} = 0\) solves this equation, but there can be other solutions. For solutions with \( \hat \eta > 0\), the conditional expectations diverge geometrically and they must have infinite unconditional moments. More generally, the potential divergence of the conditional moments is precisely the source of multiple factorizations for \(M,\) and what drives our choice of selecting one. The associated cash flow with a date \(t\) contribution, \(\phi(X_t) = {\hat e}(X_t),\) will have infinite value when \(\hat \eta > - {\tilde \eta}\).

Example 8.8

Consider a special case of Example 8.7 with \(\nu = {\sf f}_0 = {\sf f}_1 = 0. \) This makes \(M=1\). We look for solutions of the form:

\[{\hat e}(x) = \exp \left( \epsilon_1 x + \frac {\epsilon_2} 2 x^2 \right).\]

The quadratic equation of interest simplifies to:

\[{\sf b}^2 \left(\epsilon_2\right)^2 + \left( {\sf a}^2 - 1 \right) \epsilon_2 = 0.\]

This has two solutions. One is \(\epsilon_2 = 0.\) For this one, \({\hat \eta}=0\) and \({\hat e} = 1\) and gives rise to the solution that we expect. For the other one,

\[{ \epsilon}_2 = \frac {1 - {\sf a}^2} {{\sf b}^2} ,\]

\(\epsilon_1 = 0\), and

\[{\hat \eta} = - {\frac 1 2} \log \left( {\sf a}^2 \right) > 0\]

because \({\sf a}^2 < 1\).

8.10.2.3. A simple stochastic extension of the Gordon growth model#

To model stochastic growth and discounting, consider the very special case of two correlated geometric random walks with constant expected discounting or growth rates. Suppose

\[\begin{split} \log S_{t+1} - \log S_t & = \mu_s + \sigma_s W_{t+1}, S_0 = 1 \cr \log G_{t+1} - \log G_t & = \mu_g + \sigma_g W_{t+1}. \end{split}\]

where \(\mu_s\) and \(\mu_g\) are constants with \(\mu_s < 0,\) \(\mu_g > 0\), and \(\sigma_s\) and \(\sigma_g\) are constant row vectors and the \(W\) process is iid with \(W_{t+1}\) being a standard multivariate normally distributed random vector. Form the product process, \(M = SG,\) which will have the same mathematical structure:

\[\log M_{t+1} = \log M_t + \mu_s + \mu_g + \left( \sigma_s + \sigma_g \right) W_{t+1} .\]

Construct

\[\begin{split} \tilde{\eta} & \eqdef \mu_s + \mu_g + \frac {| \sigma_s + \sigma_g|^2}{2} \cr & = \left[\mu_s + \frac {| \sigma_s|^2}{2} \right] + \left[\mu_g + \frac {| \sigma_g|^2}{2} \right] + \sigma_s \cdot \sigma_g . \end{split}\]

The first term in the second line captures the negative of the implied risk-free rate of return, the second term the expected growth rate, and the third term, \(\sigma_s \cdot \sigma_g,\) includes an adjustment for uncertainty. The security with cash flow \(G\) has finite value when \(\tilde \eta < 0\) with the familiar geometric summation formula:

\[ \sum_{t=0}^\infty {\mathbb E} \left(M_t \mid G_0, X_0 = x \right) = \left[\frac 1 {1 - \exp({\tilde \eta})} \right] G_0 .\]

This computation illustrates a way to build a stochastic version of the Gordon growth model, but it has important limitations from both a conceptual and empirical perspective.

8.10.2.4. Adjusting for uncertainty with state dependence#

The stochastic example in the previous subsection has pedagogical value, but the interest rates are constant as are the cash-flow growth rates. The same is true for the one-period cash-flow exposures to the shock vector \(W_{t+1}\). We escape this straitjacket by introducing state dependence expressed as follows:

\[\begin{split} \log S_{t+1} - \log S_t & = \mu_s(X_t) + \sigma_s(X_t) W_{t+1}, S_0 = 1 \cr \log G_{t+1} - \log G_t & = \mu_g(X_t) + \sigma_g(X_t) W_{t+1}. \end{split}\]

By using the factorization of Theorem 8.1 and the unique Theorem 8.2 selection of such a representation, we return to our initial present-value analysis in Expected discounted cash flows. Write

\[\frac {M_t}{M_0} = \exp\left({\tilde \eta} t \right) {\widetilde L}_t \left[\frac {{\tilde e}(X_0)}{{\tilde e}(X_t)} \right] \]

where \(M = SG\). Consider a family of cash flows of the form

(8.24)#\[G_t f(X_t) \]

for different choices of \( f = {\tilde f } {\tilde e} \) and \(\tilde f \in {\mathcal F}(\widetilde L)\) given by (8.16). Stated in terms of logarithms, the cash flows are all cointegrated, with cointegrating coefficients one and minus one. The process \(G\) reflects a common stochastic growth component. [Hansen, 2012] explores in detail relations between cointegration as it is studied in macroeconomics and long-term valuation as it is of interest in this chapter. In particular, the set \({\mathcal F}(\widetilde L)\) imposes moment restrictions for the valuation limits. Distinct moment implications arise in other applications of cointegration.

The uncertainty-adjusted valuation of the discounted cash flows of the form given in (8.24) is given by:

\[ \sum_{t=0}^\infty \exp\left({\tilde \eta} t \right) {\widetilde {\mathbb E}} \left[ \tilde f(X_t) \Bigl| X_0 = x \right] G_0 {\tilde e}(X_0) \]

where the expectation uses the probability distribution induced by \({\widetilde L}\). Infinite values arise whenever \({\tilde \eta} \ge 0\). When \({\tilde \eta} < 0\) the valuation is finite provided that \({\widetilde {\mathbb E}} [ {\tilde f}(X_t) ]\) is finite. Thus, \({\tilde \eta}\) as a measure of the asymptotic growth or decay in \(SG,\) plays a central role in determining whether the discounted expected value of the cash-flow \(G\) is finite or not. But like the analysis in Expected discounted cash flows, there is a nuanced case in which

\[{\widetilde {\mathbb E}} \left[ \tilde f(X_t) \right] = + \infty.\]

For this infinite-moment case, whether the discounted expected value is finite or not depends on the rate of divergence in comparison to \(- {\tilde \eta}\).

Importantly, this analysis uses a change in probability measure for the computation. The change of measure mathematically resembles a standard risk-neutral probability, but it is conceptually distinct. It depends on the stochastic behavior of \(SG\) and not just \(S\). Moreover, state-dependent short-term interest rates alone imply that the risk-neutral probabilities are not the relevant ones for valuing long-term cash flows. With state-dependence in stochastic growth, it becomes valuable to move from \(S\) to \(SG,\) which builds on the Gordon-growth insight. The uncertainty adjustments for valuation depend on the implied asymptotic rate of growth or decay, \(-{\tilde \eta},\) analogous to what happens in deterministic environments. It could, however, also depend on the corresponding behavior of the conditional expectations,

\[{\widetilde {\mathbb E}} \left[ {\tilde f} (X_t) \mid X_0 = x \right]\]

of the cash flows as the payoff horizon becomes large.

Although stated in the context of a very special example, the analysis in [Panageas, 2025] reminds us that in a stochastic setting, unconditional moments can be infinite even when there is stochastic stability in the Markov process and the horizon-dependent conditional moments are finite. This means the value comparison for stochastic cash-flows with different specifications of \(f\) could be dramatically different because of the tail behavior of the stationary distributions of random variables \(f(X_t)/{\tilde e}(X_t)\) for the different \(f\)’s. More than the rate \({\tilde \eta}\) may come into play. It would appear to be hard to tell how restrictive the finite moment condition is empirically, but that does not mean we should dismiss it as a possibility. It sometimes matters when we build explicit models of valuation as illustrated by [Panageas, 2025].

8.10.3. Partitioning long-term return implications#

We study a family of cash-flow and holding period returns where the cash flows are of the form (8.24) under some moment restrictions on \(f(X_t)\). Specifically, we show that limiting returns are the same as the payoff horizon becomes long, for alternative choices of \(f > 0.\) [Jiang et al., 2024] use the valuation impact of cointegration in the relation between government spending and revenue to assess the implied value of government debt in comparison to actual direct measurements.

8.10.3.1. Cash-flow returns#

Consider two factorizations:

\[\begin{split} \frac {G_t}{G_0} & = \exp(\eta^{g} t) L_t^g \frac{ e^g(X_0 )}{e^g(X_t)} \cr \frac {S_t G_t}{G_0} & = \exp(\eta^{sg} t) L_t^{sg} \frac{ e^{sg}(X_0 )}{e^{sg}(X_t)} \end{split}\]

Given \(G\), entertain a family of cash flows that can be represented as in (8.24) for \(f>0\)-s such that

(8.25)#\[f / e^g \in {\mathcal F}(L^g) \hspace{.5cm} \textrm{and} \hspace{.5cm} f / e^{sg} \in {\mathcal F}(L^{sg}).\]

The two factorizations of interest for cash flows (8.24) are:

\[\begin{split} \frac {G_tf(X_t) }{G_0 f(X_0) } & = \exp(\eta^{g} t) L_t^g \frac{ f(X_t) e^g(X_0 )}{f(X_0) e^g(X_t)} \cr \frac {S_t G_t f(X_t) }{G_0 f(X_0) } & = \exp(\eta^{sg} t) L_t^{sg} \frac{ f(X_t) e^{sg}(X_0 )}{f(X_0)e^{sg}(X_t)} \end{split}\]

Implicit in these factorizations is that the introduction of \(f\) has neither impact on the Perron-Frobenius eigenvalues nor any effect on the multiplicative martingales. It does change the eigenfunction by replacing \(e^g\) with \(e^g/f\). With these extensions along with moment restrictions (8.25), the limiting expected growth and valuation rates are:

\[\begin{split} \lim_{t \rightarrow \infty} \frac 1 t \log {\mathbb E} \left[ G_t f(X_t) \mid {\mathfrak A}_0 \right] & = \eta^g \cr \lim_{t \rightarrow \infty} \frac 1 t \log {\mathbb E} \left[ S_t G_t f(X_t) \mid {\mathfrak A}_0 \right] & = \eta^{sg} . \end{split}\]

Observe that the limits remain the same for alternative choices of \(f>0\) as does the expected rate of return given by:

\[\eta^g - \eta^{sg}. \]

8.10.3.2. One-period holding-period returns#

We also investigate the limiting behavior of one-period holding-period returns and obtain an even stronger connection among the family of returns for cash flows satisfying (8.24). To achieve this, we revisit and extend a computation we performed previously. Consider the multiplicative factorization again and price future cash flows in single periods. (These are sometimes referred to as “strips.”) An empirical asset pricing literature has explored these returns starting with [van Binsbergen et al., 2012]. See [Golez and Jackwerth, 2024] for a recent update of this evidence.

The one-period holding period return on a \(t\)-period asset with payout \(G_tf(X_t)\) at date \(t\) is:

\[\begin{split} R^t_1[G f(X)] & = \frac {\widetilde {\mathbb E} \left[ \frac {f(X_t)}{ e^{sg}(X_t)} \Bigl| X_1 \right] } {\widetilde {\mathbb E} \left[ \frac {f(X_t) }{e^{sg}(X_t)} \Bigl| X_0 \right] } \left[ \frac {G_1 f(X_1)}{G_0 f(X_0)} \right] \left[ \frac {e^{sg}(X_1) f(X_0)}{e^{sg}(X_0) f(X_1)} \right] \left[ \frac{ \exp[\eta^{sg} (t-1)]}{\exp(\eta^{sg} t)} \right] \cr & = \frac {\widetilde {\mathbb E} \left[ \frac {f(X_t)}{ e^{sg}(X_t)} \Bigl| X_1 \right] } {\widetilde {\mathbb E} \left[ \frac {f(X_t) }{e^{sg}(X_t)} \Bigl| X_0 \right] } \left[ \frac {G_1 e^{sg}(X_1) }{G_0 e^{sg}(X_0)} \right] \exp(-\eta^{sg}) \end{split}\]

where the \(\tilde \cdot\) conditional expectation uses the probability measure induced by the positive martingale \(L^{sg}\). Using stochastic stability and taking limits as \(t\) tends to \(\infty\) gives the limiting holding-period return:

(8.26)#\[R^{\infty}_1[G f(X) ] = \exp(-\eta^{sg}) \left[ \frac {G_1 e^{sg}(X_1)}{G_0e^{sg}(X_0)} \right] = \left(\frac 1 {S_1} \right) L^{sg}_1 \]

provided that \(f/e^{sg} \in {\mathcal F}(L^{sg})\). The limiting holding-period return does not depend on \(f\).

Much of this chapter has featured factorizations that allow us to deconstruct economically interesting processes including growth processes. We now consider a way to parametrize cash-flow growth processes in terms of holding-period returns and decay rates. We do this to reveal common long-term risk exposures in positive cash-flow growth processes. Formally, we build partitions of such processes. For a given cumulative stochastic discount factor process \(S\) with \(S_0=1,\) parameterize baseline stochastic cash flows as

\[\frac {G_{t+1}}{G_t} = \exp(- \eta) R_{t+1}\]

where

  • \(\eta\) is a positive decay rate;

  • \(R\) is a one-period return process constructed as

\[\log R_{t+1} = \kappa(X_t, W_{t+1})\]

for some \(\kappa\);

  • the implied multiplicative martingale with increment

\[\frac {L_{t+1}}{L_t} = \left( \frac {S_{t+1}}{S_t} \right) R_{t+1} \]

and \(L_0 = 1\) induces a stochastically stable process for \(X\).

Notice that for a given cumulative stochastic discount factor process \(S,\) the martingale \(L\) reveals the cumulative return process \(R\) and conversely. Since we restrict \(R\) via its implications for the martingale \(L\), we use the notation \(G(\eta,L)\) to denote the baseline process. The initial condition \(G_0(\eta, L) > 0\) is inconsequential at this juncture.

For each baseline process, introduce a family of cash-flow growth processes within a partition:

\[{\mathcal G}(\eta, L) \eqdef \left\{ G(\eta, L ) f(X) : f \in {\mathcal F}(L) \right\}.\]

Notice that for each \(G\) in a partition \({\mathcal G}(\eta, L),\) we have the factorization:

\[\frac {S_t G_t}{G_0} = \exp(-\eta t) L_t \left[ \frac {f(X_t)} {f(X_0)}\right]\]

for some \(f \in {\mathcal F}(L).\) Each such member has the same one-period holding period return, \(R\).

A given cash-flow process \(G\) reveals the corresponding \((\eta, L)\) and the partition to which \(G\) belongs. Consider two cash flow processes \(G^1\) and \(G^2\) within the universe of all of the partitions that are related by:

\[\log G^1 - \log G^2 = \log {\tilde f}(X).\]

Thus they are cointegrated in logarithms with vector \((1, -1)\). These processes are necessarily within the same partition with a common \((\eta, L)\).

Remark 8.7

[Ai and Fu, 2025] extend the holding-return limits derived here to study what can be revealed by announcement impacts on financial markets. They use a continuous-time formulation with hidden states and preset announcement dates at which information is revealed about monetary policy. They study instantaneous returns at the times of the announcements. They deduce counterpart representations applicable to such holding-period returns. They use this setup to estimate long-term impacts of monetary policy announcements on the macro economy as revealed by such returns. Their analysis is facilitated by their use of log-linear models with Brownian motion increments, which opens the door to a tractable link between the multiplicative martingale increments and permanent shocks revealed by additive decompositions applied to logarithms.

8.11. Bounding investor beliefs#

We use the cumulative stochastic discount factorization to analyze two distance approaches to drawing inferences about investor beliefs.

8.11.1. Subjective beliefs in the absence of long-term risk#

Suppose that we have data on prices of one-period state-contingent claims. We can use these data to infer the one-period operator, \({\mathbb M}.\) Recall that we represent this operator using a baseline specification of the one-period transition probabilities. One possibility is that the one-period baseline transition probabilities agree with the data generation. Rational expectations models equate transition probabilities to those used by investors. More generally, investors could have subjective beliefs that differ from the baseline specification. We proceed under two restrictions:

  • investors think there are no permanent macroeconomic shocks;

  • investors do not have risk-based preferences that can induce a multiplicative martingale in a cumulative stochastic discount factor process.[2]

Under these two restrictions, we could identify \(L^s\) as the likelihood ratio for investor beliefs relative to the baseline probability distribution. Thus, the implied martingale component in the cumulative stochastic discount factor identifies the subjective beliefs of investors. Using this change of measure, the limiting long-term risk compensations derived in the previous section are zero. These assumptions facilitate “Ross recovery” of investor beliefs.[3]

8.11.2. Restricting the martingale increment with limited asset market data#

Initially, suppose we impose rational expectations by endowing investors with knowledge of the data generating process. With limited asset market data, we cannot identify the martingale component of the cumulative stochastic discount factor process without additional model restrictions. We can, however, obtain potentially useful bounds on the martingale increment. For applications beyond those of [Alvarez and Jermann, 2005], [Bakshi and Chabi-Yo, 2012], see [Koijen et al., 2010] and [Lustig et al., 2019], among others. We know that the implied martingale has some peculiar limiting behavior and that martingale and transient components can be correlated. Nevertheless, the implied probability measure can be well behaved. Consequently, in contrast to the references just cited, we use the increment as a device to represent conditional probabilities instead of just as a random variable. Extensions of these same methods can be used to study restrictions on subjective beliefs implied by asset prices.

There is a substantial literature on divergence measures for probability densities. Relative entropy is an important example. More generally, consider a convex function \(\phi\) that is zero when evaluated at one. Jensen’s inequality implies that

\[{\mathbb E} \left[ \phi(N_1) \mid X_0\right] \ge 0,\]

and equal to zero when \(N_1\) is one, provided that \(N_1\) is a multiplicative martingale increment (has conditional expectation one). This gives rise to a family of \(\phi\) divergences that can be used to assess departures from baseline probabilities. Relative entropy, \(\phi(n) = n \log n\), is an example that is particularly tractable and has been used often. Both \(n \log n\) and \(- \log n\) can be interpreted as expected log-likelihood ratios. The same family of divergences reappears in Chapter 10, where it restrains a decision maker’s search over priors and over likelihoods, and again in Chapter 13, where it measures the misspecification of a set of moment conditions.

One way of assessing the magnitude of the martingale increment to the stochastic discount factor is to solve:

Minimum divergence problem

(8.27)#\[\min_{N_1 \ge 0} {\mathbb E} \left[ \phi(N_1) \mid X_0\right] \]

subject to:

\[\begin{align} {\mathbb E} \left(N_1 \mid X_0 \right) & = 1 \cr {\mathbb E} \left[N_1 \left( \frac {\widehat S_1}{\widehat S_0} \right) Y_1\Biggl| X_0 \right] & = Q_0 \end{align}\]

where \(Y_1\) is a vector of asset payoffs and \(Q_0\) is a vector of corresponding prices, and where \({\widehat S_1}/{\widehat S_0}\) is equal to one of the two possibilities:

  • i) \(\exp(\eta^s) \frac{ e^s(X_0)} {e^s(X_1)}\) under the data generating process;

or

  • ii) an imposed stochastic discount factor allowing for subjective beliefs to differ from the data generating process.

With regards to i), recall that the term

\[\left[\exp(\eta^s) \frac{ e^s(X_0)} {e^s(X_1)}\right] = \left(R_1^\infty \right)^{-1}\]

can be approximated by the reciprocal of the one-period holding-period return on a long-term bond. With regards to ii), for a model that is misspecified under the data generating process, we can ask that the distortion induced by the subjective beliefs correct the misspecification under the data generating process.

Remark 8.8

It is enlightening to extend problem (8.27) to include an inequality constraint requiring that the conditional expectation of any random variable of interest be less than or equal to some threshold. Adding a constraint, when it binds, increases the objective. A given increase in the divergence is achieved by reducing this threshold sufficiently far. By following this procedure, we can find a lower bound on the moment of interest that increases the objective by some pre-specified percentage. Extending this approach to any bounded random variable reveals an ambiguity-induced nonlinear expectation operator, where the nonlinearity follows from our construction of a lower bound on conditional expectations. Obtaining an ambiguity interval for a given random variable follows from also constructing the lower bound for the negative of this random variable. See [Chen et al., 2020] for a more extensive discussion. Such constructions are an example of what econometricians describe as partial identification because the vector \(Y_1\) of asset payoffs used in the analysis may not be sufficient to reconstruct all potential one-period asset payoffs and prices. In effect, the econometrician is often confronted with incomplete data on financial markets.

Remark 8.9

Many researchers use \(\phi(n) = - \log n\) as a divergence measure. [Chauduri et al., 2023] and [Chen et al., 2024], however, isolate a problem with monotone decreasing divergences such as \(- \log n\): they can fail to detect certain limiting forms of deviations from baseline probabilities.

Remark 8.10

[Ghosh and Roussellet, 2023] suggest a formal econometric procedure for estimating the altered probability measure obtained by minimum divergence. Presumably their methods could be extended to produce conditional ambiguity intervals as well.

Remark 8.11

To avoid having to estimate conditional expectations, applications often study unconditional expectations. In such situations, conditioning can be brought in through the “back door” by scaling payoffs and prices with variables in the conditioning information set; for example, see [Hansen and Singleton, 1982] and [Hansen and Richard, 1987]. See [Bakshi and Chabi-Yo, 2012] and [Bakshi et al., 2017] for some related implementations.

Remark 8.12

[Alvarez and Jermann, 2005] use \(- {\mathbb E}\left( \log S_1 - \log S_0 \right) \) as the objective to be minimized. Notice that

\[\log N_1^s = \log S_1 - \log S_0 + [- \eta^s + \log e^s(X_1) - \log e^s(X_0) ] ,\]

where the term in square brackets is the logarithm of the limiting holding-period bond return (8.18). The criterion thus equals that in the minimum divergence problem, but with an additive translation. Rewrite the constraints in the minimum divergence problem as:

\[\begin{align} {\mathbb E} \left(\frac {S_1}{S_0} R_1^\infty \right) & = 1 \cr {\mathbb E} \left( \frac {S_1}{S_0} Y_1\right) & = Q_0. \end{align}\]

This leaves us with an equivalent minimization problem in which the translation term is subtracted off to obtain the bound of interest.

Applied researchers have sometimes omitted the first constraint, which weakens the bound.

8.11.2.1. Intertemporal divergence measures#

[Chen et al., 2020] propose extensions of the one-period divergence measures to multi-period counterparts that remain tractable and enlightening. By looking over time, the dynamic formulation essentially averages over the conditioning information; but it allows for subjectivity in the transition probabilities. Their dynamic measure of divergence is constructed as follows. For a given \(N\) process, let

\[L_T = \prod_{\tau=1}^T N_\tau\]

This construction provides the implied transition probability adjustments for the alternative time horizons. To represent the one-period divergence in an alternative but equivalent way, construct a function \(\psi\) such that

\[n \psi\left( \frac 1 n \right) = \phi(n).\]

The function \(\psi\) plays a role analogous to \(\phi\) when the roles between the \(N\)-implied probability and the baseline probability are interchanged. It may be shown that \(\psi\) is also strictly convex. Note also that \(\psi(1) = \phi(1) = 0\). By design,

\[{\mathbb E} \left[ \phi(N_t) \mid {\mathfrak A}_{t-1} \right] = {\mathbb E} \left[ N_t \psi\left(\frac 1 {N_t} \right) \mid {\mathfrak A}_{t-1} \right] \]

With these building blocks, [Chen et al., 2020] suggest the divergence measure:

\[\lim_{T \rightarrow \infty} {\frac 1 T} \sum_{t=1}^T {\mathbb E} \left[ L_{t-1} \phi(N_t) \mid {\mathfrak A}_{0} \right] = \lim_{T \rightarrow \infty} {\frac 1 T} \sum_{t=1}^T {\mathbb E} \left[ L_{t} \psi \left(\frac 1 {N_t} \right) \mid {\mathfrak A}_{0} \right].\]

An alternative equivalent representation may be obtained by taking a Law of Large Numbers limit under the altered probability measure. When \(\phi(n) = n \log n,\) this divergence measure coincides with the one that is pertinent for the study of Donsker-Varadhan formulations of large deviations in Markov environments. This dynamic formulation of divergences opens the door to recursions for the bounds in the divergence minimization described in Remark 8.8.

8.11.2.2. Subjective belief bounds on proportional risk premia#

The next figure reports proportional risk compensations for the market return using an illustration from [Chen et al., 2020] under a presumed data generation and when distorted investor beliefs are permitted and risk aversion is constrained to be one. The compensations condition on dividend/price ratios. The figure includes upper and lower endpoints of conditional expectations computed by extending the divergence minimization problem along the lines suggested by Remark 8.8 given by the upper and lower edges of shaded rectangles. The horizontal lines within the shaded rectangles give the conditional moments implied by the minimum divergence change in probability measure. By moving the figure’s slider, we see how ambiguity intervals decrease when we weaken the constraint on the divergence. Since the divergence measure used in the computation is explicitly dynamic, the associated subjective probabilities for the transition probabilities are also substantially altered. The implied stationary probabilities for the three states are

\[\begin{matrix} \textrm{low D/P} & \text{middle D/P} & \text{high D/P} & \cr .42 & .31 & .27 & \textrm{baseline probability} \cr .76 & .20 & .04 & \textrm{minimum entropy probability} \end{matrix}\]

Notice that the altered probabilities reflect a substantial reduction in the probability of being in the high dividend-price state, making the big conditional divergence for the high dividend-price state seem to have a smaller effect on the dynamic divergence measure.

../_images/proportional_risk_compensation_20_hline.jpg

Fig. 8.4 Proportional risk compensations computed as \(\log \mathbb{E} R^m - \log \mathbb{E} R^f\) scaled to annualized percentages. The \(\bullet\)s are the empirical averages and the boxes give the imputed bounds when we inflated the minimum relative entropy by the percentage set with the slider; the printed version shows 20%.#

8.11.2.3. Subjective belief factor#

[Cui et al., 2025] use a complementary approach to study subjective beliefs and asset prices. They use a convenient mathematical representation of linear functionals. Consistent with our previous discussion, distorted expectations are viewed as a (conditional) linear mapping from the random variables being forecast to associated conditional predictions. A belief factor is identified as the random variable that appears in this representation of a conditional linear functional in a mathematical formulation in [Hansen and Richard, 1987] and [Cerreia-Vioglio et al., 2016]. [Cui et al., 2025] use this belief factor to organize useful descriptions of various data sets containing reports of subjective beliefs. In this setting, the subjective belief factor is restricted to be a (conditional) linear combination of the variables being forecast in the data set of interest, a restriction central to econometric identification. As [Cui et al., 2025] point out, extending the subjective belief functional to include forecasts of other variables omitted from a data set under study generates subjective belief factors whose best linear (conditional) predictors equal the subjective belief factor that they construct from their smaller data set. While identification remains partial in this setting, their framework provides convenient characterizations of what can be learned and why it is informative.

[Cui et al., 2025] correctly remind us that they do not restrict the subjective belief factor to be positive. They go on to suggest a way to impose positivity under some particular distributional assumptions. By using statistical divergences, the [Chen et al., 2020] analysis avoids these auxiliary assumptions while imposing positivity. It also provides an entirely different characterization of partial identification than does the approach of [Cui et al., 2025]. There are advantages and disadvantages to both approaches.

8.12. Measuring belief distortions with survey forecasts#

Bounding investor beliefs used asset prices to bound the multiplicative-martingale component of a cumulative stochastic discount factor. [Bhandari et al., 2025] add more structure to the problem to achieve full identification of a belief-distortion martingale, using household survey forecasts of macroeconomic variables.

Their evidence and the model that they use to interpret it fit squarely within the framework of this chapter: a decision maker’s subjective beliefs are represented by a multiplicative martingale \(L\) of the type introduced earlier in this chapter (see Example 8.2), and the discrepancy between subjective and objective forecasts is a conditional expectation of the martingale increment \(N_{t+1}\) against the variable being forecast. Because the martingale is now pinned down by survey data rather than inferred from prices, the exercise turns the abstract change of measure of this chapter into a directly measured object.

8.12.1. Belief wedges as covariances with the martingale increment#

Let \({\mathbb E} \left( \cdot \mid {\mathfrak A}_t \right)\) denote a conditional expectation under a baseline (data-generating or rational-expectations) probability, and let \({\widetilde {\mathbb E}} \left( \cdot \mid {\mathfrak A}_t\right) = {\mathbb E} \left(N_{t+1} \, \cdot \mid {\mathfrak A}_t \right)\) denote the corresponding subjective conditional expectation induced, as in formula (8.3), by a multiplicative-martingale increment \(N_{t+1} \ge 0\) with \({\mathbb E} \left(N_{t+1} \mid {\mathfrak A}_t \right) = 1\). Following [Bhandari et al., 2025], define the one-period belief wedge for a variable \(Z_{t+1}\) as the gap between the subjective and the baseline forecast:

(8.28)#\[\Delta_t^{(1)}(Z) \eqdef {\widetilde {\mathbb E}} \left( Z_{t+1} \mid {\mathfrak A}_t \right) - {\mathbb E} \left( Z_{t+1} \mid {\mathfrak A}_t \right) .\]

Because \({\mathbb E} \left(N_{t+1} \mid {\mathfrak A}_t \right) = 1\), the wedge is exactly a conditional covariance between the martingale increment and the forecasted variable:

(8.29)#\[\Delta_t^{(1)}(Z) = {\mathbb E} \left(N_{t+1} Z_{t+1} \mid {\mathfrak A}_t \right) - {\mathbb E} \left(N_{t+1} \mid {\mathfrak A}_t \right) {\mathbb E} \left( Z_{t+1} \mid {\mathfrak A}_t \right) = {\rm Cov}_t \left(N_{t+1}, Z_{t+1}\right) .\]

A positive wedge signals that the decision maker overweights states in which \(Z_{t+1}\) is high relative to the baseline probability. The martingale increment \(N_{t+1}\) studied throughout this chapter is more than a device for changing measures. Its covariation with observable variables is what a forecast survey measures.

8.12.2. The optimal distortion is an exponential multiplicative martingale#

[Bhandari et al., 2025] obtain a specific \(N_{t+1}\) from robust or multiplier preferences of the type initiated by [Hansen and Sargent, 2001] and developed in [Hansen and Sargent, 2008]. A decision maker who distrusts a baseline model replaces the ordinary continuation value \({\mathbb E} \left( {\widehat V}_{t+1} \mid {\mathfrak A}_t \right)\) by the outcome of the minimization

(8.30)#\[\min_{N_{t+1} \ge 0, \ {\mathbb E}\left(N_{t+1} \mid {\mathfrak A}_t \right) = 1} {\mathbb E} \left(N_{t+1} {\widehat V}_{t+1} \mid {\mathfrak A}_t \right) + \frac 1 {\theta_t} {\mathbb E} \left( N_{t+1} \log N_{t+1} \mid {\mathfrak A}_t \right),\]

where \({\widehat V}_{t+1}\) is a continuation value and \(\theta_t > 0\) is a pessimism parameter that penalizes departures of \(N_{t+1}\) from unity as measured by conditional relative entropy. This is precisely the entropy-penalized problem (11.5) of Chapter 11, with \(\theta_t\) equal to the inverse penalty \(\frac 1 \xi = \gamma - 1\). Its minimizer is the exponentially tilted increment

(8.31)#\[N_{t+1}^* = \frac { \exp \left( - \theta_t {\widehat V}_{t+1} \right)}{{\mathbb E} \left[ \exp \left( - \theta_t {\widehat V}_{t+1} \right) \mid {\mathfrak A}_t \right]},\]

which is nonnegative and has conditional expectation one, so it is a multiplicative-martingale increment of exactly the type of Example 8.2. Since (8.31) shifts probability toward states in which the continuation value \({\widehat V}_{t+1}\) is low, \(\theta_t > 0\) encodes pessimism. Allowing \(\theta_t\) to depend on the state, and in particular to change sign, lets the same construction express optimism (\(\theta_t < 0\)), which tilts probability toward high-continuation-value states. [Bhandari et al., 2025] reinterpret the robust-control distortion as a model of belief and let survey data discipline the process for \(\theta_t\); this also resolves an identification problem, because with unitary intertemporal elasticity these preferences are observationally equivalent to recursive utility with time-varying risk aversion \(\gamma_t = \theta_t + 1\), and survey forecasts, unlike prices, distinguish time-varying pessimism from time-varying risk premia.

Compounding the increments as in (8.4) builds the likelihood ratio process \(L_t = \prod_{j=1}^t N_j^*\), and formula (8.5) delivers the multi-period subjective forecasts

\[{\widetilde {\mathbb E}} \left( Z_{t+\tau} \mid {\mathfrak A}_t \right) = {\mathbb E} \left[ \left(\frac{L_{t+\tau}}{L_t} \right) Z_{t+\tau} \mid {\mathfrak A}_t \right]\]

that the survey elicits at horizons beyond one period. The \(\tau\)-period wedge \(\Delta_t^{(\tau)}(Z) = {\widetilde {\mathbb E}}(Z_{t+\tau}\mid {\mathfrak A}_t) - {\mathbb E}(Z_{t+\tau} \mid {\mathfrak A}_t)\) is thus a compounded version of the one-period object (8.28), exactly as multi-period changes of measure compound one-period increments elsewhere in this chapter.

8.12.3. Gaussian dynamics: the distortion is a mean shift#

Suppose that the state follows the log-linear Gaussian law of motion

\[X_{t+1} = \psi_q + \psi_x X_t + \psi_w W_{t+1}, \qquad W_{t+1} \sim {\mathcal N}(0, {\mathbb I}),\]

and that the continuation value is affine, \({\widehat V}_{t+1} \approx v_x X_{t+1} + \textrm{constant}\), with \(v_x\) a row vector of continuation-value sensitivities. Then the exponent in (8.31) is affine in \(W_{t+1}\), and the optimal increment collapses to

(8.32)#\[N_{t+1}^* = \exp \left( \nu_t \cdot W_{t+1} - {\frac 1 2} \left| \nu_t \right|^2 \right), \qquad \nu_t = - \theta_t \left( v_x \psi_w \right)' .\]

This is an exponential martingale of exactly the form (8.14) in Example 8.6: under the implied change of probability measure, the shock is simply re-centered,

\[W_{t+1} \sim {\mathcal N} \left( \nu_t, {\mathbb I} \right),\]

so pessimism is a mean shift of the innovation equal to the negative of the pessimism parameter times the exposure \(v_x \psi_w\) of the continuation value to the shock. Fig. 8.5 illustrates the shift for the scalar calibration of [Bhandari et al., 2025].

../_images/belief_wedge_mean_shift.png

Fig. 8.5 The belief distortion (8.32) as a change of probability measure that shifts the mean of the Gaussian innovation. Larger pessimism \(\theta_t\) moves the perceived distribution of the shock to the left, toward states with lower continuation values. Because the true shift \(\nu_t = -\theta_t \left( v_x \psi_w \right)'\) is tiny at this calibration, the horizontal axis is scaled by \(1/\psi_w\), so the plotted shift is \(-\theta_t v_x\).#

The wedge (8.29) then has the closed form. For any variable \(Z_{t+1} = {\bar z}' X_{t+1}\) that is linear in the state,

(8.33)#\[\Delta_t^{(1)}(Z) = {\bar z}' \psi_w \nu_t = - \theta_t \, {\bar z}' \psi_w \psi_w' v_x' = - \theta_t \, {\rm Cov}_t \left( Z_{t+1}, {\widehat V}_{t+1} \right) ,\]

so the belief wedge is the pessimism parameter times the conditional covariance between the forecasted variable and the continuation value. When \(Z_{t+1}\) is a “good” variable such as consumption (\(v_x > 0\)), the wedge is negative and the decision maker underforecasts it; when \(Z_{t+1}\) enters the continuation value with a negative sign, as unemployment does, the same pessimism produces a positive wedge, an overforecast. When the pessimism parameter is itself state dependent, \(\theta_t = {\bar \theta} X_t\), the mean shift (8.32) alters not just the intercept but also the persistence of the perceived law of motion, replacing \(\psi_x\) by \({\widetilde \psi}_x = \psi_x - \psi_w ( v_x \psi_w )' {\bar \theta}\); adverse states are more persistent under the subjective measure than under the baseline, so pessimists believe that bad times last longer.

8.12.4. One factor, and what survey data discipline#

Formula (8.33) has a sharp implication. The time variation in every belief wedge is governed by the single scalar \(\theta_t\), while the cross-sectional loadings \(-{\bar z}' \psi_w \psi_w' v_x'\) are conditional covariances between shocks and continuation values. These loadings are not free parameters: they are equilibrium objects determined by the model’s structure, so each additional surveyed variable adds an overidentifying restriction. A single common belief factor should therefore account for the joint movement of the wedges across variables.

[Bhandari et al., 2025] confirm this prediction in the Michigan Survey of Consumers. Household forecasts of unemployment and inflation display wedges that are positive on average, countercyclical (larger in recessions, when \(\theta_t\) is high), and dominated by a single principal component that accounts for roughly four-fifths of their joint variation. Calibrating the belief factor \(\theta_t\) to these moments and feeding it through a New Keynesian model, they find that the resulting belief shock substantially reduces the unemployment volatility puzzle of [Shimer, 2005] that standard technology and monetary-policy shocks cannot resolve.

This survey-based strategy is complementary to the asset-price bounds of Bounding investor beliefs. There, incomplete asset-market data delivered only a bound on the martingale increment of a stochastic discount factor; here, direct forecast data identify the belief martingale itself. In both cases the magnitude of the admissible distortion is governed by the same conditional relative entropy \({\mathbb E} \left(N_{t+1} \log N_{t+1} \mid {\mathfrak A}_t \right)\) that appears in the penalty (8.30), and the statistical detectability of the implied belief distortion is measured by the Chernoff entropy discussed earlier in this chapter. Persistent belief wedges of the size seen in surveys correspond to changes of measure that a statistician would find difficult to reject in samples of the length available, which is precisely why the distortions can survive as durable features of investor behavior.

Remark 8.13

The construction here is the same multiplicative martingale that Remark 8.2 used to study whether investors with distorted beliefs survive. Where [Borovička, 2020] characterizes preferences under which optimists are not driven out of the market in the long run, [Bhandari et al., 2025] use survey forecasts to measure the belief distortion period by period. Both exploit the fact, central to this chapter, that a subjective model is encoded in a multiplicative-martingale change of measure relative to a baseline probability.

8.13. Chernoff entropy reconsidered#

In Chapter 7, we introduced Chernoff entropy as a statistical measure of distance between two probabilities. We now return to that discussion by extracting an asymptotic decay rate from a multiplicative factorization. Let \(L\) be a martingale constructed as a likelihood ratio process and construct:

\[M = L^\alpha \hspace{.5cm} 0 < \alpha < 1. \]

The martingale \(L\) represents the probabilities of an alternative model relative to a baseline one. Its increment is

\[N_{t+1} = \frac {L_{t+1}}{L_t}. \]

Let \({\tilde \eta}(\alpha)\) be the principal eigenvalue exponent in the Theorem 8.1 factorization of \(M = L^\alpha\), selected as in Theorem 8.2, so that \({\tilde \eta}(\alpha) \le 0\). Consistent with the convention of Chapter 7, the asymptotic decay rate is the nonnegative quantity

\[\eta(\alpha) \eqdef - {\tilde \eta}(\alpha) ,\]

and the corresponding Chernoff entropy is given by

\[\max_{0< \alpha < 1} \eta(\alpha ). \]

It gives the asymptotic rate of discrimination between the baseline model and the alternative as more data become available. Large decay rates say that learning eventually becomes easy; small rates say that it does not.

Example 8.9

A researcher considers two possible autoregressive models of a scalar time series:

\[\begin{split}\begin{split} & X_{t+1} \mid X_t = x \sim \mathcal{N}({\sf a}_1 x,\, 1),\\ & X_{t+1} \mid X_t = x \sim \mathcal{N}({\sf a}_2 x,\, 1), \end{split}\end{split}\]

Let \(f_1(y \mid x)\) and \(f_2(y \mid x)\) be conditional normal densities given by:

\[\begin{align*} f_1(y \mid x) &= \phi(y - {\sf a}_1 x), \\ f_2(y \mid x) &= \phi(y - {\sf a}_2 x) , \end{align*}\]

where \(\phi\) denotes the standard normal density. Define the kernel

\[K(y, x) = f_2(y \mid x)^{\alpha}\, f_1(y \mid x)^{1-\alpha}, \qquad 0 < \alpha < 1.\]

We seek the principal eigenfunction \(g\) and eigenvalue \(\lambda\) satisfying

\[\lambda\, g(x) \;=\; \int K(y,x)\,g(y)\,dy.\]

It may be verified that the principal eigenfunction is an exponential quadratic function of the state. The eigenvalue problem may be solved uniquely by restricting the eigenvalue to be positive. The constructed martingale in the factorization induces an alternative stable autoregression. The following figure illustrates the computation and the resulting Chernoff entropies for alternative values of the AR coefficient. The reported \({\sf a}_{\alpha^*}\)’s give the corresponding AR coefficients for the stability verifications.

../_images/chernoff_unknown_ar.png

Fig. 8.6 The function \(\eta(\alpha)\) for the unknown AR coefficient example, with \({\sf a}_1 = .95\), \({\sf b} = 1\), and alternative values of \({\sf a}_2\). Its maximum is the Chernoff entropy (dashed line), attained at \(\alpha^*\) (dot).#

Unknown AR coefficient

Alternative \({\sf a}_2\)
1.00
Chernoff entropy
-
\({\sf a}_{\alpha^*}\)
-
\({\sf b}_{\alpha^*}\)
-
Interactive Chernoff decay-rate plot for the unknown AR coefficient example.

Orange dot = \(\alpha^*\). Dashed line = optimized value.

The interactive plot requires Chart.js to load in the browser.

Example 8.10

A researcher considers two possible autoregressive models of a scalar time series:

\[\begin{split}\begin{split} & X_{t+1} \mid X_t = x \sim \mathcal{N}({\sf a} x,\, {\sf b}_1),\\ & X_{t+1} \mid X_t = x \sim \mathcal{N}({\sf a} x,\, {\sf b}_2), \end{split}\end{split}\]

where the autoregression coefficient is known and the same for each model, but the value of \({\sf b}\) is not. We entertain two possible values for \({\sf b}\). We proceed analogously to the previous example. In this case, the principal eigenfunction is constant with a unique solution for the eigenvalue. The following figure illustrates the computation and the resulting Chernoff entropies for alternative values of the conditional volatility parameter \({\sf b}\). The reported \({\sf b}_{\alpha^*}\)’s give the corresponding uncertainty exposure coefficients for the stability verifications. The entropies are notably higher than for the unknown AR coefficient case in the previous example, suggesting that the time series data are more informative for the conditional volatility coefficient.

../_images/chernoff_unknown_vol.png

Fig. 8.7 The function \(\eta(\alpha)\) for the unknown conditional volatility example, with \({\sf a} = .95\), \({\sf b}_1 = 1\), and alternative values of \({\sf b}_2\). Its maximum is the Chernoff entropy (dashed line), attained at \(\alpha^*\) (dot).#

Unknown conditional volatility

Alternative \({\sf b}_2\)
1.50
Chernoff entropy
-
\({\sf a}_{\alpha^*}\)
-
\({\sf b}_{\alpha^*}\)
-
Interactive Chernoff decay-rate plot for the unknown conditional volatility example.

Orange dot = \(\alpha^*\). Dashed line = optimized value.

The interactive plot requires Chart.js to load in the browser.

8.14. Summary#

Exponentiating an additive functional gives a multiplicative functional, which grows or decays geometrically rather than linearly. Theorem 8.1 factors it into three pieces: a deterministic geometric trend \(\exp(t{\tilde \eta})\), a multiplicative martingale, and a ratio of a principal eigenfunction evaluated at the initial and current states. That eigenfunction solves (8.8), the growing counterpart of the unit-eigenvalue problem of Chapter 2, and Theorem 8.2 supplies the stochastic stability that makes the factorization the one to use for long-horizon questions.

The factorization does the work in each application. The martingale component determines long-term valuation and the limiting risk-return tradeoff; it also carries the belief distortions measured against survey forecasts. Chernoff entropy from Chapter 7 returns as a bound on how far distorted beliefs can stray before a statistician could detect them, which is why distortions of the size seen in surveys can persist. Chapter 9 perturbs these functionals to obtain shock elasticities.

8.15. Exercises#

The Appendix to Chapter 8 reports the Chernoff entropy computations.