1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
|
---
title: "Wiener process"
firstLetter: "W"
publishDate: 2021-10-29
categories:
- Physics
- Mathematics
- Stochastic analysis
date: 2021-10-21T19:40:02+02:00
draft: false
markup: pandoc
---
# Wiener process
The **Wiener process** is a [stochastic process](/know/concept/stochastic-process/)
that provides a pure mathematical definition
of the physical phenomenon of **Brownian motion**,
and hence is also called *Brownian motion*.
A Wiener process $B_t$ is defined as any
stochastic process $\{B_t: t \ge 0\}$ that satisfies:
1. Initial condition $B_0 = 0$.
2. Each **increment** of $B_t$ is independent of the past:
given $0 \le s < t \le u < v$, then
$B_t \!-\! B_s$ and $B_v \!-\! B_u$ are independent random variables.
3. The increments of $B_t$ are Gaussian with mean $0$
and variance $h$, where $h$ is the time step,
such that $B_{t+h} \!-\! B_t \sim \mathcal{N}(0, h)$.
4. $B_t$ is a continuous function of $t$.
There exist stochastic processes that satisfy these requirements,
infinitely many in fact.
In other words, Brownian motion exists,
and can be constructed in various ways.
Since the variance of an increment is expressed in units of time $t$,
the physical unit of the Wiener process is the square root of time $\sqrt{t}$.
Brownian motion is **self-similar**:
if we define a rescaled $W_t = \sqrt{\alpha} B_{t/\alpha}$ for some $\alpha$,
then $W_t$ is also a valid Wiener process,
meaning that there are no fundemental scales.
A consequence of this is that:
$\mathbf{E}|B_t|^p = \mathbf{E}|\sqrt{t} B_1|^p = t^{p/2} \mathbf{E}|B_1|^p$.
Another consequence is invariance under "time inversion",
by defining $\sqrt{\alpha} = t$, such that $W_t = t B_{1/t}$.
Despite being continuous by definition,
the Wiener process is not differentiable in general,
not even in the mean square, because:
$$\begin{aligned}
\frac{B_{t+h} - B_t}{h}
\sim \frac{1}{h} \mathcal{N}(0, h)
\sim \mathcal{N}\Big(0, \frac{1}{h}\Big)
\qquad \quad
\lim_{h \to 0} \mathbf{E} \bigg|\mathcal{N}\Big(0, \frac{1}{h}\Big) \bigg|^2
= \infty
\end{aligned}$$
Furthermore, the Wiener process is a good example
of both a [martingale](/know/concept/martingale/)
and a [Markov process](/know/concept/markov-process/),
since each increment has mean zero (so it is a martingale),
and all increments are independent (so it is a Markov process).
## Recurrence
An important question about the Wiener process
is whether it is **recurrent** or **transient**:
given a hypersphere (interval in 1D, circle in 2D, sphere in 3D)
away from the origin, will $B_t$ visit it after a finite time $\tau\!<\!\infty$?
It is *recurrent* if yes, i.e. $P(\tau \!<\! \infty) = 1$, or *transient* otherwise.
The answer to this question turns out to depend on the number of dimenions.
To demonstrate this, we model the $d$-dimensional Wiener process
as an [Itō diffusion](/know/concept/ito-calculus/) $X_t$,
which also allows us to shift the initial condition $X_0$
(or resume a "paused" process):
$$\begin{aligned}
X_t
= X_0 + \int_0^t \dd{B_s}
\end{aligned}$$
Consider two hyperspheres, the inner with radius $R_i$,
and the outer with $R_o > R_i$.
Let the initial condition $|X_0| \in \, ]R_i, R_o[$,
then we define the stopping times $\tau_i$, $\tau_o$ and $\tau$ like so:
$$\begin{aligned}
\tau_i
\equiv \inf\{ t : |X_t| \le R_i \}
\qquad
\tau_o
\equiv \inf\{ t : |X_t| \ge R_o \}
\qquad
\tau
\equiv \min\{\tau_i, \tau_o\}
\end{aligned}$$
We stop when the inner or outer hypersphere is touched by $X_t$,
whichever happens first.
[Dynkin's formula](/know/concept/dynkins-formula/)
is applicable to this situation, if we define $h(x)$ as follows,
where the *terminal reward* $\Gamma$ equals $1$ for $|X_\tau| = R_i$,
and $0$ for $|X_\tau| = R_o$,
such that $h(X_0)$ equals the probability
that we touch $R_i$ before $R_o$ for a given $X_0$:
$$\begin{aligned}
h(X_0)
= \mathbf{E}\Big[ \Gamma(X_\tau) \Big| X_0 \Big]
= P\Big[|X_\tau| \!=\! R_i \:\Big|\: X_0\Big]
\end{aligned}$$
Dynkin's formula then tells us that $h(x)$ is given by the following equation,
with the boundary conditions $h(R_i) = 1$ and $h(R_o) = 0$:
$$\begin{aligned}
0
= \hat{L}\{h(x)\}
= \frac{1}{2} \nabla^2 h(x)
\end{aligned}$$
Thanks to this problem's spherical symmetry,
$h$ only depends on the radial coodinate $r$,
so the Laplacian $\nabla^2$ can be written as follows
in $d$-dimensional [spherical coordinates](/know/concept/spherical-coordinates/):
$$\begin{aligned}
0
= \nabla^2 h(r)
= \pdv[2]{h}{r} + \frac{d - 1}{r} \pdv{h}{r}
\end{aligned}$$
For $d = 1$, the solution $h_1(r)$ is as follows,
of which we take the limit for $R_o \to \infty$:
$$\begin{aligned}
h_1(r)
= \frac{r - R_o}{R_i - R_o}
\quad\underset{R_o \to \infty}{\longrightarrow}\quad
1
\end{aligned}$$
The outer hypersphere becomes harder to reach for larger $R_o$,
and for $R_o \to \infty$ we are left with
the probability of hitting $R_i$ only.
This turns out to be $1$, so in 1D the Wiener process is recurrent:
it always comes close to the origin in finite time.
For $d = 2$, the solution $h_2(r)$ is as follows,
whose limit turns out to be $1$,
so the Wiener process is also recurrent in 2D:
$$\begin{aligned}
h_2(r)
= 1 - \frac{\log\!(r/R_i)}{\log\!(R_o/R_i)}
\quad\underset{R_o \to \infty}{\longrightarrow}\quad
1
\end{aligned}$$
However, for $d \ge 3$, the solution $h_d(r)$
does not converge to $1$ for $R_o \to \infty$,
meaning the Wiener process is transient in 3D or higher:
$$\begin{aligned}
h_d(r)
= \frac{R_o^{2 - d} - r^{2 - d}}{R_o^{2 - d} - R_i^{2 - d}}
\quad\underset{R_o \to \infty}{\longrightarrow}\quad
\frac{R_i^{d - 2}}{r^{d - 2}}
< 1
\end{aligned}$$
This is a major qualitative difference. For example, consider a situation
where some substance is diffusing from a localized infinite source:
in 3D, the substance can escape and therefore a steady state can exist,
while in 2D, the substance never strays far from the source,
so no steady state is ever reached as long as the source continues to emit.
## References
1. U.H. Thygesen,
*Lecture notes on diffusions and stochastic differential equations*,
2021, Polyteknisk Kompendie.
|
