Feynman–Kac formula

The Feynman–Kac formula, named after Richard Feynman and Mark Kac, establishes a link between parabolic partial differential equations and stochastic processes. In 1947, when Kac and Feynman were both faculty members at Cornell University, Kac attended a presentation of Feynman's and remarked that the two of them were working on the same thing from different directions.^[1] The Feynman–Kac formula resulted, which proves rigorously the real-valued case of Feynman's path integrals. The complex case, which occurs when a particle's spin is included, is still an open question.^[2]

It offers a method of solving certain partial differential equations by simulating random paths of a stochastic process. Conversely, an important class of expectations of random processes can be computed by deterministic methods.

Theorem

Consider the partial differential equation ${\frac {\partial }{\partial t}}u(x,t)+\mu (x,t){\frac {\partial }{\partial x}}u(x,t)+{\tfrac {1}{2}}\sigma ^{2}(x,t){\frac {\partial ^{2}}{\partial x^{2}}}u(x,t)-V(x,t)u(x,t)+f(x,t)=0,$ defined for all $x\in \mathbb {R}$ and $t\in [0,T]$ , subject to the terminal condition $u(x,T)=\psi (x),$ where $\mu ,\sigma ,\psi ,V,f$ are known functions, $T$ is a parameter, and $u:\mathbb {R} \times [0,T]\to \mathbb {R}$ is the unknown. Then the Feynman–Kac formula expresses $u(x,t)$ as a conditional expectation under the probability measure $Q$

$u(x,t)=E^{Q}\left[e^{-\int _{t}^{T}V(X_{\tau },\tau )\,\mathrm {d} \tau }\psi (X_{T})+\int _{t}^{T}e^{-\int _{t}^{\tau }V(X_{s},s)\,\mathrm {d} s}f(X_{\tau },\tau )\,\mathrm {d} \tau \,{\Bigg |}\,X_{t}=x\right]$

where $X$ is an Itô process satisfying $\mathrm {d} X_{t}=\mu (X_{t},t)\,\mathrm {d} t+\sigma (X_{t},t)\,\mathrm {d} W_{t}^{Q},$ and $W_{t}^{Q}$ a Wiener process (also called Brownian motion) under $Q$ .

Intuitive interpretation

Suppose that the position $X_{t}$ of a particle evolves according to the diffusion process $dX_{t}=\mu (X_{t},t)\,\mathrm {d} t+\sigma (X_{t},t)\,\mathrm {d} W_{t}^{Q}.$ Let the particle incur "cost" at a rate of $f(X_{s},s)$ at location $X_{s}$ at time $s$ . Let it incur a final cost at $\psi (X_{T})$ .

Also, allow the particle to decay. If the particle is at location $X_{s}$ at time $s$ , then it decays with rate $V(X_{s},s)$ . After the particle has decayed, all future cost is zero.

Then $u(x,t)$ is the expected cost-to-go, if the particle starts at $(t,X_{t}=x).$

Partial proof

A proof that the above formula is a solution of the differential equation is long, difficult and not presented here. It is however reasonably straightforward to show that, if a solution exists, it must have the above form. The proof of that lesser result is as follows:

Let $u(x,t)$ be the solution to the above partial differential equation. Applying the product rule for Itô processes to the process $Y(s)=\exp \left(-\int _{t}^{s}V(X_{\tau },\tau )\,d\tau \right)u(X_{s},s)+\int _{t}^{s}\exp \left(-\int _{t}^{r}V(X_{\tau },\tau )\,d\tau \right)f(X_{r},r)\,dr$ one gets: ${\begin{aligned}dY_{s}={}&d\left(\exp \left(-\int _{t}^{s}V(X_{\tau },\tau )\,d\tau \right)\right)u(X_{s},s)+\exp \left(-\int _{t}^{s}V(X_{\tau },\tau )\,d\tau \right)\,du(X_{s},s)\\[6pt]&{}+d\left(\exp \left(-\int _{t}^{s}V(X_{\tau },\tau )\,d\tau \right)\right)du(X_{s},s)+d\left(\int _{t}^{s}\exp \left(-\int _{t}^{r}V(X_{\tau },\tau )\,d\tau \right)f(X_{r},r)\,dr\right)\end{aligned}}$

Since $d\left(\exp \left(-\int _{t}^{s}V(X_{\tau },\tau )\,d\tau \right)\right)=-V(X_{s},s)\exp \left(-\int _{t}^{s}V(X_{\tau },\tau )\,d\tau \right)\,ds,$ the third term is $O(dt\,du)$ and can be dropped. We also have that $d\left(\int _{t}^{s}\exp \left(-\int _{t}^{r}V(X_{\tau },\tau )\,d\tau \right)f(X_{r},r)dr\right)=\exp \left(-\int _{t}^{s}V(X_{\tau },\tau )\,d\tau \right)f(X_{s},s)ds.$

Applying Itô's lemma to $du(X_{s},s)$ , it follows that ${\begin{aligned}dY_{s}={}&\exp \left(-\int _{t}^{s}V(X_{\tau },\tau )\,d\tau \right)\,\left(-V(X_{s},s)u(X_{s},s)+f(X_{s},s)+\mu (X_{s},s){\frac {\partial u}{\partial X}}+{\frac {\partial u}{\partial s}}+{\tfrac {1}{2}}\sigma ^{2}(X_{s},s){\frac {\partial ^{2}u}{\partial X^{2}}}\right)\,ds\\[6pt]&{}+\exp \left(-\int _{t}^{s}V(X_{\tau },\tau )\,d\tau \right)\sigma (X,s){\frac {\partial u}{\partial X}}\,dW.\end{aligned}}$

The first term contains, in parentheses, the above partial differential equation and is therefore zero. What remains is: $dY_{s}=\exp \left(-\int _{t}^{s}V(X_{\tau },\tau )\,d\tau \right)\sigma (X,s){\frac {\partial u}{\partial X}}\,dW.$

Integrating this equation from $t$ to $T$ , one concludes that: $Y(T)-Y(t)=\int _{t}^{T}\exp \left(-\int _{t}^{s}V(X_{\tau },\tau )\,d\tau \right)\sigma (X,s){\frac {\partial u}{\partial X}}\,dW.$

Upon taking expectations, conditioned on $X_{t}=x$ , and observing that the right side is an Itô integral, which has expectation zero,^[3] it follows that: $E[Y(T)\mid X_{t}=x]=E[Y(t)\mid X_{t}=x]=u(x,t).$

The desired result is obtained by observing that: $E[Y(T)\mid X_{t}=x]=E\left[\exp \left(-\int _{t}^{T}V(X_{\tau },\tau )\,d\tau \right)u(X_{T},T)+\int _{t}^{T}\exp \left(-\int _{t}^{r}V(X_{\tau },\tau )\,d\tau \right)f(X_{r},r)\,dr\,{\Bigg |}\,X_{t}=x\right]$ and finally $u(x,t)=E\left[\exp \left(-\int _{t}^{T}V(X_{\tau },\tau )\,d\tau \right)\psi (X_{T})+\int _{t}^{T}\exp \left(-\int _{t}^{s}V(X_{\tau },\tau )\,d\tau \right)f(X_{s},s)\,ds\,{\Bigg |}\,X_{t}=x\right]$

Remarks

The proof above that a solution must have the given form is essentially that of ^[4] with modifications to account for $f(x,t)$ .
The expectation formula above is also valid for N-dimensional Itô diffusions. The corresponding partial differential equation for $u:\mathbb {R} ^{N}\times [0,T]\to \mathbb {R}$ becomes:^[5] ${\frac {\partial u}{\partial t}}+\sum _{i=1}^{N}\mu _{i}(x,t){\frac {\partial u}{\partial x_{i}}}+{\frac {1}{2}}\sum _{i=1}^{N}\sum _{j=1}^{N}\gamma _{ij}(x,t){\frac {\partial ^{2}u}{\partial x_{i}\partial x_{j}}}-r(x,t)\,u=f(x,t),$ where, $\gamma _{ij}(x,t)=\sum _{k=1}^{N}\sigma _{ik}(x,t)\sigma _{jk}(x,t),$ i.e. $\gamma =\sigma \sigma ^{\mathrm {T} }$ , where $\sigma ^{\mathrm {T} }$ denotes the transpose of $\sigma$ .
More succinctly, letting $A$ be the infinitesimal generator of the diffusion process, ${\frac {\partial u}{\partial t}}+Au-r(x,t)\,u=f(x,t),$
This expectation can then be approximated using Monte Carlo or quasi-Monte Carlo methods.
When originally published by Kac in 1949,^[6] the Feynman–Kac formula was presented as a formula for determining the distribution of certain Wiener functionals. Suppose we wish to find the expected value of the function $\exp \left(-\int _{0}^{t}V(x(\tau ))\,d\tau \right)$ in the case where x(τ) is some realization of a diffusion process starting at $x (0) = 0$ . The Feynman–Kac formula says that this expectation is equivalent to the integral of a solution to a diffusion equation. Specifically, under the conditions that $uV(x)\geq 0$ , $E\left[\exp \left(-u\int _{0}^{t}V(x(\tau ))\,d\tau \right)\right]=\int _{-\infty }^{\infty }w(x,t)\,dx$ where $w (x, 0) = δ (x)$ and ${\frac {\partial w}{\partial t}}={\frac {1}{2}}{\frac {\partial ^{2}w}{\partial x^{2}}}-uV(x)w.$

The Feynman–Kac formula can also be interpreted as a method for evaluating functional integrals of a certain form. If $I=\int f(x(0))\exp \left(-u\int _{0}^{t}V(x(t))\,dt\right)g(x(t))\,Dx$ where the integral is taken over all random walks, then $I=\int w(x,t)g(x)\,dx$ where $w (x, t)$ is a solution to the parabolic partial differential equation ${\frac {\partial w}{\partial t}}={\frac {1}{2}}{\frac {\partial ^{2}w}{\partial x^{2}}}-uV(x)w$ with initial condition $w (x, 0) = f (x)$ .

Applications

Finance

In quantitative finance, the Feynman–Kac formula is used to efficiently calculate solutions to the Black–Scholes equation to price options on stocks^[7] and zero-coupon bond prices in affine term structure models.

For example, consider a stock price $S_{t}$ undergoing geometric Brownian motion $dS_{t}=(r_{t}dt+\sigma _{t}dW_{t})S_{t}$ where $r_{t}$ is the risk-free interest rate and $\sigma _{t}$ is the volatility. Equivalently, by Itô's lemma, $d\ln S_{t}=\left(r_{t}-{\tfrac {1}{2}}\sigma _{t}^{2}\right)dt+\sigma _{t}\,dW_{t}.$ Now consider a European call option on an $S_{t}$ expiring at time $T$ with strike $K$ . At expiry, it is worth $(X_{T}-K)^{+}.$ Then, the risk-neutral price of the option, at time $t$ and stock price $x$ , is $u(x,t)=E\left[e^{-\int _{t}^{T}r_{s}ds}(S_{T}-K)^{+}|\ln S_{t}=\ln x\right].$ Plugging into the Feynman–Kac formula, we obtain the Black–Scholes equation: ${\begin{cases}\partial _{t}u+Au-r_{t}u=0\\u(x,T)=(x-K)^{+}\end{cases}}$ where ${\textstyle A=(r_{t}-\sigma _{t}^{2}/2)\partial _{\ln x}+{\frac {1}{2}}\sigma _{t}^{2}\partial _{\ln x}^{2}=r_{t}x\partial _{x}+{\frac {1}{2}}\sigma _{t}^{2}x^{2}\partial _{x}^{2}.}$ More generally, consider an option expiring at time $T$ with payoff $g(S_{T})$ . The same calculation shows that its price $u(x,t)$ satisfies ${\begin{cases}\partial _{t}u+Au-r_{t}u=0\\u(x,T)=g(x).\end{cases}}$ Some other options like the American option do not have a fixed expiry. Some options have value at expiry determined by the past stock prices. For example, an average option has a payoff that is not determined by the underlying price at expiry but by the average underlying price over some predetermined period of time. For these, the Feynman–Kac formula does not directly apply.

Quantum mechanics

In quantum chemistry, it is used to solve the Schrödinger equation with the Pure Diffusion Monte Carlo method.^[8]

References

^ Kac, Mark (1987). Enigmas of Chance: An Autobiography. University of California Press. pp. 115–16. ISBN 0-520-05986-7.
^ Glimm, James; Jaffe, Arthur (1987). Quantum Physics: A Functional Integral Point of View (2 ed.). New York, NY: Springer. pp. 43–44. doi:10.1007/978-1-4612-4728-9. ISBN 978-0-387-96476-8. Retrieved 13 April 2021.
^ Øksendal, Bernt (2003). "Theorem 3.2.1.(iii)". Stochastic Differential Equations. An Introduction with Applications (6th ed.). Springer-Verlag. p. 30. ISBN 3540047581.
^ "PDE for Finance".
^ See Pham, Huyên (2009). Continuous-time stochastic control and optimisation with financial applications. Springer-Verlag. ISBN 978-3-642-10044-4.
^ Kac, Mark (1949). "On Distributions of Certain Wiener Functionals". Transactions of the American Mathematical Society. 65 (1): 1–13. doi:10.2307/1990512. JSTOR 1990512. This paper is reprinted in Baclawski, K.; Donsker, M. D., eds. (1979). Mark Kac: Probability, Number Theory, and Statistical Physics, Selected Papers. Cambridge, Massachusetts: The MIT Press. pp. 268–280. ISBN 0-262-11067-9.
^ Paolo Brandimarte (6 June 2013). "Chapter 1. Motivation". Numerical Methods in Finance and Economics: A MATLAB-Based Introduction. John Wiley & Sons. ISBN 978-1-118-62557-6.
^ Caffarel, Michel; Claverie, Pierre (15 January 1988). "Development of a pure diffusion quantum Monte Carlo method using a full generalized Feynman–Kac formula. I. Formalism". The Journal of Chemical Physics. 88 (2): 1088–1099. Bibcode:1988JChPh..88.1088C. doi:10.1063/1.454227.

v t e Richard Feynman
Career	Feynman diagram Feynman–Kac formula Wheeler–Feynman absorber theory Bethe–Feynman formula Hellmann–Feynman theorem Feynman slash notation Feynman parametrization Path integral formulation Parton model Sticky bead argument One-electron universe Quantum cellular automaton Rogers Commission Report Feynman checkerboard Feynman sprinkler
Works	"There's Plenty of Room at the Bottom" (1959) The Feynman Lectures on Physics (1964) The Character of Physical Law (1965) QED: The Strange Theory of Light and Matter (1985) Surely You're Joking, Mr. Feynman! (1985) What Do You Care What Other People Think? (1988) Feynman's Lost Lecture: The Motion of Planets Around the Sun (1997) The Meaning of It All (1999) The Pleasure of Finding Things Out (1999) Perfectly Reasonable Deviations from the Beaten Track (2005)
Family	Joan Feynman (sister) Charles Hirshberg (nephew)
Related	Namesakes Cargo cult science Quantum Man: Richard Feynman's Life in Science Tuva or Bust! Feynman Prize in Nanotechnology Infinity (1996 film) QED (2001 play) The Challenger Disaster (2013 film)