arXiv reader

Random Processes with Stationary Increments and Intrinsic Random Functions on the Real Line

Jongwook Kim

arXiv
2501.15680v2 · PDF · 4 December 2025
Categories
math.PR, math.ST, stat.TH
Journal
Stat 14, no. 4: e70128
DOI
10.1002/sta4.70128
Licence
CC BY 4.0 The site shows the text.

Abstract

Random processes with stationary increments and intrinsic random processes are two concepts commonly used to deal with non-stationary random processes. They are broader classes than stationary random processes and conceptually closely related to each other. This paper illustrates the relationship between these two concepts of stochastic processes and shows that, under certain conditions, they are equivalent on the real line.

Items 17

Definition

Definition 2.1

24CM

(Yaglom 1958; Wei Chen et al. 2024) [Yaglom1958] [Chen2024]
\{X(t), t \in \mathbb{R}\} is called a random process with stationary increments of order d \in \mathbb{Z} (d \ge 0), denoted I(d), if \Delta_{\iota}^{d}X(t) is stationary where

\Delta_{\iota}^{d}X(t) = \sum_{k=0}^{d} (-1)^k \binom{d}{k} X(t - k\iota), \quad t,\iota \in \mathbb{R} \quad d \in \mathbb{Z}_{\ge 0}

Additionally, D^d(h; \iota_1, \iota_2) is its structure function where

D^d(h;\iota_1,\iota_2) = E\bigl([\Delta_{\iota_1}^{d}X(t+h)] [\Delta_{\iota_2}^{d}X(t)]\bigl), \quad h,\iota_1,\iota_2 \in \mathbb{R}

This is positive semi-definite.

Remark

Remark 1

IGM3

(Yaglom 1987) [yaglom1987correlation], Let X(t) be a random process with stationary increments with order d, and Y(t) be a stationary random process such that Y=X^{(d)}, which is a d-th derivative (or generalized derivative) of X, where t,h \in \mathbb{R}. Since Y(t) is stationary,

\begin{aligned} &Y(t) = \int_{-\infty}^{\infty}e^{i \omega t}dZ_y(\omega), \quad E \bigl(Y(t+h) \cdot Y(t) \bigl) = C_y(h) = \int_{-\infty}^{\infty}e^{i \omega h}dF_y(\omega), \end{aligned}

where F_y(\omega) is a bounded non-decreasing function and E(|dZ_y(\omega)|^2) = dF_y(\omega) for Z_y(\omega), a random function with uncorrelated increments. Then, we can achieve the following spectral representations:

\begin{aligned} X(t) &= \int_{-\infty}^{\infty} \bigl( e^{it\omega} -1 - it\omega - \cdots - \frac{(i t \omega)^{d-1}}{(d-1)!} \bigl) dZ(\omega) + X_0 + X_1 t + \cdots + X_d t^d \\ \Delta_{\iota}^d X(t) &= \int_{-\infty}^{\infty} e^{i\omega t} (1-e^{-i \iota\omega})^d dZ(\omega) + (d!) X_d \iota^d \\ D(h; \iota_1,\iota_2) &= \int_{-\infty}^{\infty} e^{i\omega h} (1-e^{-i \omega \iota_1})^d (1-e^{i \omega \iota_2})^d dF(\omega) + (d!)^2 A_d^2 \iota_1^d \iota_2^d \end{aligned}

Where \int_{-\infty}^{\infty} = \lim_{T \rightarrow \infty, \epsilon \rightarrow 0} \{ \int_{-T}^{-\epsilon} + \int_{\epsilon}^{T}\}, Z(\omega_2) - Z(\omega_1) = \int_{-\omega_1}^{\omega_2} \frac{dZ_y(\omega)}{(i \omega)^d}, and F(\omega_2) - F(\omega_1) = \int_{-\omega_1}^{\omega_2} \frac{dF_y(\omega)}{\omega^{2d}}. A random variable X_0 = X(0) and X_1, X_2, \cdots, X_{d-1} are some random variables. A random variable X_d is introduced in order to deal with the jump discontinuity at \omega=0. These random variables X_0, X_1, \cdots, X_d can, in particular, be constants. In the structure function, \langle|X_d| \rangle = A_d^2 \ge 0.

Used by Proof
Remark

Remark 2

N9WR

(Yaglom 1987) [yaglom1987correlation] If the correlation function of C_y(h) in (?) decays rapidly with respect to h, that is,

\begin{aligned} &\int_{-\infty}^{\infty} |C_y(h)|^2 dh < \infty \end{aligned}

then, the random variable X_d and A_d in (?), (?), and (?) are zero, and the spectral density function of the process X(t) exists; thus, the spectral distribution function dF(\omega) in (?) can be expressed as f(\omega)d\omega where f(\omega) = F'(\omega). In the later part of this research, we assume the condition in (2) is satisfied. We also assume that the random variables X_0, X_1, \cdots, X_{d-1} are zero for simplicity.

Used by Proof
Remark

Remark 3

HXV9

(Chiles and Delfiner 1999) [Chiles1999] The differencing operator \Delta_{\iota} in Definition 2.1 reduces the degree of the polynomial by one level. That is, if we suppose any polynomial function with any degree n \in \mathbb{N} such as

p_n(t) = \sum_{i=0}^{n} a_{i} t^i

Then,

\Delta_{\iota} p_n(t) = \sum_{i=1}^{n} a_i p^*_{i-1}(t) \quad \text{where} \quad p^*_{i-1}(t) = -\sum_{j=0}^{i-1} \binom{i}{j} t^{j} (-\iota)^{i-j}
Used by Proof
Definition

Definition 2.2

N7F6

(Matheron 1973 ; Chiles and Delfiner 1999) [Materon1973] [Chiles1999] Let \Lambda_d be the space of measures with compact supports and \lambda \in \Lambda_d. \lambda is an allowable measure of order d on \mathbb{R} if it annihilates polynomials of degree less than d. That is,

f(\lambda) = \int f(x) \lambda(dx)

and for a polynomial function p(\cdot) of degree less than d,

p(\lambda) = \int p(x) \lambda(dx) = 0

where \ell=0,1,2,\cdots, d-1. We denote that \Lambda_d is a class of such allowable measures, and then it is clear that \Lambda_{d+1} \subset \Lambda_{d}.

Remark

Remark 4

XI0O

(Chiles and Delfiner 1999) [Chiles1999] An allowable measure \lambda \in \Lambda_d is closed under translations of shift. That is,

p_{d-1}(\tau_h \lambda) = \int p_{d-1}(x+h) \lambda(dx) = 0

where p_{d-1}(\cdot) is a polynomial function of degree d-1 and \tau_h is a shift operator by h \in \mathbb{R}.

Definition

Definition 2.3

6WLB

A random process X(t) on the real line is an intrinsic random function with its order d, denoted IRF(d), if the process X(\lambda) is shift invariant for any t \in \mathbb{R} and any \lambda \in \Lambda_d. That is, for any allowable measure \lambda \in \Lambda_d and any \tau_h \in \mathrm{G} where \mathrm{G} is a group of shift operators and h \in \mathbb{R}, it satisfies that

\begin{aligned} &E\bigl(X(\lambda) \bigl) = E\bigl(X(\tau_h \lambda) \bigl)\\ &Cov\bigl(X(\lambda_1), X(\lambda_2) \bigl) = Cov\bigl(X(\tau_h \lambda_1), X(\tau_h \lambda_2) \bigl) \quad \text{where} \quad \text{any }\lambda_1, \lambda_2 \in \Lambda_d \end{aligned}
Used by Proof
Remark

Remark 5

DERX

A stationary random process is denoted as an IRF(0). Note that this notation differs slightly from Matheron’s (1793) [Materon1973], where a stationary process is represented by IRF(-1). In this paper, \kappa \ge 1 is used to describe nonstationary random processes, instead of \kappa \ge 0.

Definition

Definition 2.4

WZAB

Let a random process X(t) be an IRF(d) and let \Lambda_d be the space of allowable measures of order d. The intrinsic covariance function K(\cdot) of X(t) is the stationary function that defines the covariance between any two allowable linear combinations, X(\lambda_1) and X(\lambda_2), for all \lambda_1, \lambda_2 \in \Lambda_d, such that:

Cov\bigl(X(\lambda_1), X(\lambda_2)\bigl) = \int_{\mathbb{R}} \int_{\mathbb{R}} K(x-y) \, \lambda_1(dx) \, \lambda_2(dy).

This stationary function K(\cdot) is called the Intrinsic Covariance Function ICF of order d, and is also widely referred to as a Generalized Covariance Function (Matheron 1793; Chiles and Delfiner 1999) [Materon1973] [Chiles1999]..

Lemma

Lemma 1

ZMY6

Define

\lambda_{\Delta_{\iota,t}^d} := \sum_{k=0}^{d} (-1)^k \binom{d}{k} \delta_{t - k\iota}, \quad t,\iota \in \mathbb{R}.

Suppose that X(t) is an IRF(d). Then, \lambda_{\Delta_{\iota,t}^d} \in \Lambda_d, and X(\lambda_{\Delta_{\iota,t}^d}) = \Delta_{\iota}^d X(t). That is, the finite difference operator \Delta_{\iota}^d, defined in Definition 2.1, corresponds to an allowable measure for an IRF(d) and annihilates all polynomials of degree up to d-1.

Used by Proof
Proof of Lemma 1

First, suppose p_{d-1}(t) is a polynomial of degree d-1. Since p_{d-1}(\lambda_{\Delta_{\iota,t}})=\Delta_{\iota} p_{d-1}(t), by Remark 3, \Delta_{\iota} p_{d-1}(t) becomes a polynomial of order d-2. Then, it is obvious that \Delta_{\iota}^{d-1}p_{d-1}(t) is a polynomial with degree 0, which is a constant.
Since

p_{d-1}(\lambda_{\Delta_{\iota,t}^d}) = \Delta_{\iota}^{d}p_{d-1}(t) = \Delta_{\iota} \biggl\{\Delta_{\iota}^{d-1} p_{d-1}(t) \biggl\},

we can conclude that

\Delta_{\iota}^{d} p_{d-1}(x) = 0

To sum up, \Delta_{\iota}^{d} annihilates polynomials of degree d-1; thus, it is an allowable measure of order d.

Definition

Definition 3.1

J4LL

Suppose that X(\cdot) is a random process on the real line \mathbb{R}. Then, the process is called (weakly) stationary if

E\biggl( X(t) \biggl) = E\biggl( X(\tau_h t) \biggl)

and

Cov\biggl( X(t), X(s) \biggl) = Cov\biggl( X(\tau_h t), X(\tau_h s) \biggl)

for any t,s,h \in \mathbb{R} and any \tau_h \in \mathrm{G} where \mathrm{G} is a group of shift operators.

Lemma

Lemma 2

N3L5

Suppose Y(t) is stationary for t \in \mathbb{R} and continuous in quadratic mean. Then, Y(\lambda) is stationary for any allowable measure with any order. That is,

E\bigl(Y(\lambda) \bigl) = E\bigl(Y(\tau_h\lambda) \bigl)
Cov\bigl(Y(\lambda_1), Y(\lambda_2) \bigl) = Cov\bigl(Y(\tau_h \lambda_1), Y(\tau_h \lambda_2) \bigl)

for any \lambda, \lambda_1, \lambda_2 \in \Lambda_d where d is any positive integer, and \tau_h, a shift operator with any h \in \mathbb{R}.

Used by Proof
Proof of Lemma 2

Suppose that the random process Y(t) is stationary for t \in \mathbb{R}, as in Definition 3.1, and let \lambda \in \Lambda_d be any allowable measure with compact support, where d \in \mathbb{Z}_+.

\begin{aligned} E\bigl( Y(\lambda) \bigl) &= E\bigl( \int Y(t) \lambda(dt) \bigl)\\ &= \int E\bigl( Y(t) \bigl) \lambda(dt) \end{aligned}

since the order of integration and expectation can be interchanged by the Fubini’s theorem in that \lambda has compact support (finite measure) and Y(t) is continuous in quadratic mean (implying integrability in the L^2 sense). Then, by stationarity of Y(t) in terms of t, for any h\in \mathbb{R}, we can also state that

\begin{aligned} \int E\bigl( Y(t) \bigl) \lambda(dt) &= \int E\bigl( Y(t+h) \bigl) \lambda(dt)\\ &= E\bigl( \int Y(t+h) \lambda(dt) \bigl) = E\bigl( Y(\tau_h \lambda) \bigl)\\ \end{aligned}

since \tau_h \lambda is still a finite measure.

Similarly, for any \lambda_1, \lambda_2 \in \Lambda_d with compact support, d \in \mathbb{Z}_+, and t,s \in \mathbb{R},

\begin{aligned} Cov\bigl( Y(\lambda_1), Y(\lambda_2) \bigl) &= Cov\bigl( \int Y(t) \lambda_1(dt), \int Y(s) \lambda_{2}(ds) \bigl)\\ &= \int \int Cov\bigl( Y(t), Y(s) \bigl) \lambda_1(dt) \lambda_2(ds) \quad \text{(by Fubini's thoerem with the same reasons)} \end{aligned}

By stationarity of Y(t) in terms of any t \in \mathbb{R}, for any h\in \mathbb{R},

\begin{aligned} Cov\bigl( Y(\lambda_1), Y(\lambda_2) \bigl) &= Cov\bigl( \int Y(t) \lambda_1(dt), \int Y(s) \lambda_{2}(ds) \bigl)\\ &= \int \int Cov\bigl( Y(t+h), Y(s+h) \bigl) \lambda_1(dt) \lambda_2(ds)\\ &= Cov\bigl(\int Y(t+h) \lambda_1(dt), \int Y(s+h) \lambda_2(ds) \bigl)\\ &= Cov\bigl( Y(\tau_h \lambda_1), Y(\tau_h \lambda_2) \bigl) \end{aligned}

Therefore, if Y(t) is stationary for any t \in \mathbb{R}, then Y(\lambda) is stationary for \lambda, an allowable measure with any order.

Theorem

Theorem 1

JLPS

For d \ge 1 and d \in \mathbb{Z}, a stochastic process X(t) is an intrinsic random function of order d (IRF(d)) on the real line if and only if X(t) is a random process with stationary increments order d provided that the condition in Remark 2.

Proof of Theorem 1

(\Rightarrow) Let a random process X(\cdot) be an intrinsic random function with order d on the real line, and define

\lambda_{\Delta_{\iota,t}^{d}} := \sum_{k=0}^{d} (-1)^k \binom{d}{k} \delta_{t - k\iota}, \quad t,\iota \in \mathbb{R}.

Then, X(\lambda_{\Delta_{\iota,t}^{d}}) = \Delta_{\iota}^{d} X(t) and by Lemma 1, \lambda_{\Delta_{\iota,t}^{d}} is allowable with its degree d on \mathbb{R}.

By Definition 2.3 of an intrinsic random function, for an allowable measure \lambda_{\Delta_{\iota,t}^{d}}, \lambda_{\Delta_{\iota,s}^{d}} \in \Lambda_{d} and any t,s,x \in \mathbb{R},

\begin{aligned} &E\bigl(X(\lambda_{\Delta_{\iota,t}^{d}}) \bigl) = E\bigl(X(\tau_x\lambda_{\Delta_{\iota,t}^{d}}) \bigl) \\ &Cov\bigl(X(\lambda_{\Delta_{\iota,t}^{d}}), X(\lambda_{\Delta_{\iota,s}^{d}}) \bigl) = Cov\bigl(X(\tau_x \lambda_{\Delta_{\iota,t}^{d}}), X(\tau_x \lambda_{\Delta_{\iota,s}^{d}}) \bigl) \end{aligned}

Since X(\lambda_{\Delta_{\iota,t}^{d}}) = \Delta_{\iota}^{d} X(t) and X(\lambda_{\Delta_{\iota,s}^{d}}) = \Delta_{\iota}^{d} X(s), Equation (?) and (?) can also be expressed as

\begin{aligned} &E\bigl( \Delta_{\iota}^{d} X(t) \bigl) = E\bigl( \Delta_{\iota}^{d} X(\tau_x t) \bigl)\\ &Cov\bigl( \Delta_{\iota}^{d} X(t), \Delta_{\iota}^{d} X(s) \bigl) = Cov\bigl( \Delta_{\iota}^{d} X(\tau_x t), \Delta_{\iota}^{d} X(\tau_x s) \bigl) \end{aligned}

Hence, \Delta_{\iota}^{d} X(t) is stationary, which implies that X(t) is a random process with stationary increments of order d.

(\Leftarrow) Suppose X_d(t) is a random process with stationary increments of order d. Then, by its spectral representation given in Remark 1 and the condition in Remark 2,

X(t) = \int_{-\infty}^{\infty} \bigl( e^{it\omega} -1 - it\omega - \cdots - \frac{(i t \omega)^{d-1}}{(d-1)!} \bigl) dZ(\omega)

Then, for any allowable measure \lambda \in \Lambda_d with compact support,

\begin{aligned} X(\lambda) &= \int_\mathbb{R} \int_{-\infty}^{\infty} \bigl( e^{it\omega} -1 - it\omega - \cdots - \frac{(i t \omega)^{d-1}}{(d-1)!} \bigl) dZ(\omega) \lambda(dt)\\ &= \int_{-\infty}^{\infty} \int_\mathbb{R} \bigl( e^{i t \omega} -1 - it\omega - \cdots - \frac{(i t \omega)^{d-1}}{(d-1)!} \bigl) \lambda(dt) dZ(\omega) \quad \text{(by Fubini's theorem).}\\ \end{aligned}

Since \lambda has compact support, the inner integral is finite. Furthermore, because X(t) is a random process (assumed L^2) and \lambda \in \Lambda_d, X(\lambda) is guaranteed to be in L^2(\Omega), where \mathbf{\Omega} denotes the sample space. This justifies the use of the Fubini’s theorem to interchange the order of stochastic and Lebesgue-Stieltjes integration. By the definition of an allowable measure, any \lambda \in \Lambda_{d} annihilates polynomials of its order d-1. Hence,

X(\lambda)=\int_{-\infty}^{\infty} \int_\mathbb{R} e^{i t \omega} \lambda(dt) dZ(\omega) = \int_\mathbb{R} \int_{-\infty}^{\infty} e^{i t \omega} dZ(\omega) \lambda(dt) \quad \text{(by Fubini's theorem again).}

Therefore, by defining Y^*(t) := \int_{-\infty}^{\infty} e^{it\omega} dZ(\omega), which is a stationary process for t \in \mathbb{R},

X(\lambda) = \int_\mathbb{R} Y^*(t) \lambda(t) = Y^*(\lambda)

Since Y^*(t) is stationary with respect to t, Y^*(\lambda) is stationary with respect to \lambda by Lemma 2. Therefore, X(\lambda) is stationary for \lambda as well. In conclusion, X(t) is an intrinsic random function of order d on the real line.

Remark

Remark 6

J8BK

Let X(\cdot) be an intrinsic random function of order d on \mathbb{R}, denoted as IRF(d). Let K(\cdot) be its intrinsic covariance function of X(\cdot) in Definition 2.4. Then, the structure function E\biggl( \Delta_{\iota_1}^{d}X(t) \cdot \Delta_{\iota_2}^{d}X(s) \biggl) in Definition 2.1 can be expressed in terms of the intrinsic covariance function as

\begin{aligned} E\bigl( \Delta_{\iota_1}^{d}X(t) \cdot \Delta_{\iota_2}^{d}X(s) \bigl) &= \sum_{k_1=0}^{d} (-1)^{k_1} \binom{d}{k_1} \sum_{k_2=0}^{d} (-1)^{k_2} \binom{d}{k_2} K\bigl( (t - k_1 \iota_1) - (s-k_2 \iota_2) \bigl) \end{aligned}

Source and licence

The text on this page is from arXiv:2501.15680v2 by Jongwook Kim, under the licence CC BY 4.0. The corpus made these changes: it read the items out of the LaTeX source, it expanded the macros of the paper, it put each proof after its statement, and it converted the text to HTML. The formulas are the TeX of the paper, and KaTeX renders them. A formula or a reference can look different from the PDF. The page is published under CC BY 4.0.

The record of each item is in analysis/objects/2501/2501.15680.jsonl.