Jump to content

Measure-preserving dynamical system

From Wikipedia, the free encyclopedia
(Redirected from KS Entropy)

In mathematics, a measure-preserving dynamical system is an object of study in the abstract formulation of dynamical systems, and ergodic theory in particular. Measure-preserving systems obey the Poincaré recurrence theorem, and are a special case of conservative systems. They provide the formal, mathematical basis for a broad range of physical systems, and, in particular, many systems from classical mechanics (in particular, most non-dissipative systems) as well as systems in thermodynamic equilibrium.

Definition

[edit]

A measure-preserving dynamical system is defined as a probability space and a measure-preserving transformation on it. In more detail, it is a system

with the following structure:

  • is a set,
  • is a σ-algebra over ,
  • is a probability measure, so that , and ,
  • is a measurable transformation which preserves the measure , i.e., .

Discussion

[edit]

One may ask why the measure preserving transformation is defined in terms of the inverse instead of the forward transformation . This can be understood intuitively.

Consider the typical measure on the unit interval , and a map . This is the Bernoulli map. Now, distribute an even layer of paint on the unit interval , and then map the paint forward. The paint on the half is spread thinly over all of , and the paint on the half as well. The two layers of thin paint, layered together, recreates the exact same paint thickness.

More generally, the paint that would arrive at subset comes from the subset . For the paint thickness to remain unchanged (measure-preserving), the mass of incoming paint should be the same: .

Consider a mapping of power sets:

Consider now the special case of maps which preserve intersections, unions and complements (so that it is a map of Borel sets) and also sends to (because we want it to be conservative). Every such conservative, Borel-preserving map can be specified by some surjective map by writing . Of course, one could also define , but this is not enough to specify all such possible maps . That is, conservative, Borel-preserving maps cannot, in general, be written in the form .

has the form of a pushforward, whereas is generically called a pullback. Almost all properties and behaviors of dynamical systems are defined in terms of the pushforward. For example, the transfer operator is defined in terms of the pushforward of the transformation map ; the measure can now be understood as an invariant measure; it is just the Frobenius–Perron eigenvector of the transfer operator (recall, the FP eigenvector is the largest eigenvector of a matrix; in this case it is the eigenvector which has the eigenvalue one: the invariant measure.)

There are two classification problems of interest. One, discussed below, fixes and asks about the isomorphism classes of a transformation map . The other, discussed in transfer operator, fixes and , and asks about maps that are measure-like. Measure-like, in that they preserve the Borel properties, but are no longer invariant; they are in general dissipative and so give insights into dissipative systems and the route to equilibrium.

In terms of physics, the measure-preserving dynamical system often describes a physical system that is in equilibrium, for example, thermodynamic equilibrium. One might ask: how did it get that way? Often, the answer is by stirring, mixing, turbulence, thermalization or other such processes. If a transformation map describes this stirring, mixing, etc. then the system is all that is left, after all of the transient modes have decayed away. The transient modes are precisely those eigenvectors of the transfer operator that have eigenvalue less than one; the invariant measure is the one mode that does not decay away. The rate of decay of the transient modes are given by (the logarithm of) their eigenvalues; the eigenvalue one corresponds to infinite half-life.

Informal example

[edit]

The microcanonical ensemble from physics provides an informal example. Consider, for example, a fluid, gas or plasma in a box of width, length and height consisting of atoms. A single atom in that box might be anywhere, having arbitrary velocity; it would be represented by a single point in A given collection of atoms would then be a single point somewhere in the space The "ensemble" is the collection of all such points, that is, the collection of all such possible boxes (of which there are an uncountably-infinite number). This ensemble of all-possible-boxes is the space above.

In the case of an ideal gas, the measure is given by the Maxwell–Boltzmann distribution. It is a product measure, in that if is the probability of atom having position and velocity , then, for atoms, the probability is the product of of these. This measure is understood to apply to the ensemble. So, for example, one of the possible boxes in the ensemble has all of the atoms on one side of the box. One can compute the likelihood of this, in the Maxwell–Boltzmann measure. It will be enormously tiny, of order Of all possible boxes in the ensemble, this is a ridiculously small fraction.

The only reason that this is an "informal example" is because writing down the transition function is difficult, and, even if written down, it is hard to perform practical computations with it. Difficulties are compounded if there are interactions between the particles themselves, like a van der Waals interaction or some other interaction suitable for a liquid or a plasma; in such cases, the invariant measure is no longer the Maxwell–Boltzmann distribution. The art of physics is finding reasonable approximations.

This system does exhibit one key idea from the classification of measure-preserving dynamical systems: two ensembles, having different temperatures, are inequivalent. The entropy for a given canonical ensemble depends on its temperature; as physical systems, it is "obvious" that when the temperatures differ, so do the systems. This holds in general: systems with different entropy are not isomorphic.

Examples

[edit]
Example of a (Lebesgue measure) preserving map: T : [0,1) → [0,1),

Unlike the informal example above, the examples below are sufficiently well-defined and tractable that explicit, formal computations can be performed.

Generalization to groups and monoids

[edit]

The definition of a measure-preserving dynamical system can be generalized to the case in which T is not a single transformation that is iterated to give the dynamics of the system, but instead is a monoid (or even a group, in which case we have the action of a group upon the given probability space) of transformations Ts : XX parametrized by sZ (or R, or N ∪ {0}, or [0, +∞)), where each transformation Ts satisfies the same requirements as T above.[1] In particular, the transformations obey the rules:

  • , the identity function on X;
  • , whenever all the terms are well-defined;
  • , whenever all the terms are well-defined.

The earlier, simpler case fits into this framework by defining Ts = Ts for sN.

Homomorphisms

[edit]

The concept of a homomorphism and an isomorphism may be defined.

Consider two dynamical systems and . Then a mapping

is a homomorphism of dynamical systems if it satisfies the following three properties:

  1. The map is measurable.
  2. For each , one has .
  3. For -almost all , one has .

The system is then called a factor of .

The map is an isomorphism of dynamical systems if, in addition, there exists another mapping

that is also a homomorphism, which satisfies

  1. for -almost all , one has ;
  2. for -almost all , one has .

Hence, one may form a category of dynamical systems and their homomorphisms.

Generic points

[edit]

A point xX is called a generic point if the orbit of the point is distributed uniformly according to the measure.

Symbolic names and generators

[edit]

Consider a dynamical system , and let Q = {Q1, ..., Qk} be a partition of X into k measurable pair-wise disjoint sets. Given a point xX, clearly x belongs to only one of the Qi. Similarly, the iterated point Tnx can belong to only one of the parts as well. The symbolic name of x, with regards to the partition Q, is the sequence of integers {an} such that

The set of symbolic names with respect to a partition is called the symbolic dynamics of the dynamical system. A partition Q is called a generator or generating partition if μ-almost every point x has a unique symbolic name.

Operations on partitions

[edit]

Given a partition Q = {Q1, ..., Qk} and a dynamical system , define the T-pullback of Q as

Further, given two partitions Q = {Q1, ..., Qk} and R = {R1, ..., Rm}, define their refinement as

With these two constructs, the refinement of an iterated pullback is defined as

which plays crucial role in the construction of the measure-theoretic entropy of a dynamical system.

Measure-theoretic entropy

[edit]

The entropy of a partition is defined as[2][3]

The measure-theoretic entropy of a dynamical system with respect to a partition Q = {Q1, ..., Qk} is then defined as

Finally, the Kolmogorov–Sinai metric or measure-theoretic entropy of a dynamical system is defined as

where the supremum is taken over all finite measurable partitions. A theorem of Yakov Sinai in 1959 shows that the supremum is actually obtained on partitions that are generators. Thus, for example, the entropy of the Bernoulli process is log 2, since almost every real number has a unique binary expansion. That is, one may partition the unit interval into the intervals [0, 1/2) and [1/2, 1]. Every real number x is either less than 1/2 or not; and likewise so is the fractional part of 2nx.

If the space X is compact and endowed with a topology, or is a metric space, then the topological entropy may also be defined.

If is an ergodic, piecewise expanding, and Markov on , and is absolutely continuous with respect to the Lebesgue measure, then we have the Rokhlin formula[4] (section 4.3 and section 12.3 [5]):This allows calculation of entropy of many interval maps, such as the logistic map.

Ergodic means that implies has full measure or zero measure. Piecewise expanding and Markov means that there is a partition of into finitely many open intervals, such that for some , on each open interval. Markov means that for each from those open intervals, either or .

Classification and anti-classification theorems

[edit]

One of the primary activities in the study of measure-preserving systems is their classification according to their properties. That is, let be a measure space, and let be the set of all measure preserving systems . An isomorphism of two transformations defines an equivalence relation The goal is then to describe the relation . A number of classification theorems have been obtained; but quite interestingly, a number of anti-classification theorems have been found as well. The anti-classification theorems state that there are more than a countable number of isomorphism classes, and that a countable amount of information is not sufficient to classify isomorphisms.[6][7]

The first anti-classification theorem, due to Hjorth, states that if is endowed with the weak topology, then the set is not a Borel set.[8] There are a variety of other anti-classification results. For example, replacing isomorphism with Kakutani equivalence, it can be shown that there are uncountably many non-Kakutani equivalent ergodic measure-preserving transformations of each entropy type.[9]

These stand in contrast to the classification theorems. These include:

Krieger finite generator theorem[14] (Krieger 1970) — Given a dynamical system on a Lebesgue space of measure 1, where is invertible, measure preserving, and ergodic.

If for some integer , then the system has a size- generator.

If the entropy is exactly equal to , then such a generator exists iff the system is isomorphic to the Bernoulli shift on symbols with equal measures.

See also

[edit]

References

[edit]
  1. ^ a b Walters, Peter (2000). An Introduction to Ergodic Theory. Springer. ISBN 0-387-95152-0.
  2. ^ Sinai, Ya. G. (1959). "On the Notion of Entropy of a Dynamical System". Doklady Akademii Nauk SSSR. 124: 768–771.
  3. ^ Sinai, Ya. G. (2007). "Metric Entropy of Dynamical System" (PDF).
  4. ^ The Shannon-McMillan-Breiman Theorem
  5. ^ Pollicott, Mark; Yuri, Michiko (1998). Dynamical Systems and Ergodic Theory. London Mathematical Society Student Texts. Cambridge: Cambridge University Press. ISBN 978-0-521-57294-1.
  6. ^ Foreman, Matthew; Weiss, Benjamin (2019). "From Odometers to Circular Systems: A Global Structure Theorem". Journal of Modern Dynamics. 15: 345–423. arXiv:1703.07093. doi:10.3934/jmd.2019024. S2CID 119128525.
  7. ^ Foreman, Matthew; Weiss, Benjamin (2022). "Measure preserving Diffeomorphisms of the Torus are unclassifiable". Journal of the European Mathematical Society. 24 (8): 2605–2690. arXiv:1705.04414. doi:10.4171/JEMS/1151.
  8. ^ Hjorth, G. (2001). "On invariants for measure preserving transformations". Fund. Math. 169 (1): 51–84. doi:10.4064/FM169-1-2. S2CID 55619325.
  9. ^ Ornstein, D.; Rudolph, D.; Weiss, B. (1982). Equivalence of measure preserving transformations. Mem. American Mathematical Soc. Vol. 37. ISBN 0-8218-2262-4.
  10. ^ Halmos, P.; von Neumann, J. (1942). "Operator methods in classical mechanics. II". Annals of Mathematics. (2). 43 (2): 332–350. doi:10.2307/1968872. JSTOR 1968872.
  11. ^ Sinai, Ya. (1962). "A weak isomorphism of transformations with invariant measure". Doklady Akademii Nauk SSSR. 147: 797–800.
  12. ^ Ornstein, D. (1970). "Bernoulli shifts with the same entropy are isomorphic". Advances in Mathematics. 4 (3): 337–352. doi:10.1016/0001-8708(70)90029-0.
  13. ^ Katok, A.; Hasselblatt, B. (1995). "Introduction to the modern theory of dynamical systems". Encyclopedia of Mathematics and its Applications. Vol. 54. Cambridge University Press.
  14. ^ Downarowicz, Tomasz (2011). Entropy in dynamical systems. New Mathematical Monographs. Cambridge: Cambridge University Press. p. 106. ISBN 978-0-521-88885-1.

Further reading

[edit]
  • Michael S. Keane, "Ergodic theory and subshifts of finite type", (1991), appearing as Chapter 2 in Ergodic Theory, Symbolic Dynamics and Hyperbolic Spaces, Tim Bedford, Michael Keane and Caroline Series, Eds. Oxford University Press, Oxford (1991). ISBN 0-19-853390-X (Provides expository introduction, with exercises, and extensive references.)
  • Lai-Sang Young, "Entropy in Dynamical Systems" (pdf; ps), appearing as Chapter 16 in Entropy, Andreas Greven, Gerhard Keller, and Gerald Warnecke, eds. Princeton University Press, Princeton, NJ (2003). ISBN 0-691-11338-6
  • T. Schürmann and I. Hoffmann, The entropy of strange billiards inside n-simplexes. J. Phys. A 28(17), page 5033, 1995. PDF-Document (gives a more involved example of measure-preserving dynamical system.)