Labor omnia vincit improbus. VIRGIL, Georgica I, 144-145. In the first part of his Theoria combinationis observationum erroribus min- imis obnoxiae, published in 1821, Carl Friedrich Gauss [Gau80, p.10] deduces a Chebyshev-type inequality for a probability density function, when it only has the property that its value always decreases, or at least does l not increase, if the absolute value of x increases . One may therefore conjecture that Gauss is one of the first scientists to use the property of 'single-humpedness' of a probability density function in a meaningful probabilistic context. More than seventy years later, zoologist W.F.R. Weldon was faced with 'double- humpedness'. Indeed, discussing peculiarities of a population of Naples crabs, possi- bly connected to natural selection, he writes to Karl Pearson (E.S. Pearson [Pea78, p.328]): Out of the mouths of babes and sucklings hath He perfected praise! In the last few evenings I have wrestled with a double humped curve, and have overthrown it. Enclosed is the diagram...If you scoff at this, I shall never forgive you. Not only did Pearson not scoff at this bimodal probability density function, he examined it and succeeded in decomposing it into two 'single-humped curves' in his first statistical memoir (Pearson [Pea94]).

The aim of" the present monograph is two-fold: (a) to give a short account of the main results concerning the theory of random systems with complete connections, and (b) to describe the general learning model by means of random systems with complete connections. The notion of chain with complete connections has been introduced in probability theory by ONICESCU and MIHOC (1935a). These authors have set themselves the aim to define a very broad type of dependence which takes into account the whole history of the evolution and thus includes as a special case the Markovian one. In a sequel of papers of the period 1935-1937, ONICESCU and MIHOC developed the theory of these chains for the homogeneous case with a finite set of states from differ ent points of view: ergodic behaviour, associated chain, limit laws. These results led to a chapter devoted to these chains, inserted by ONI CESCU and MIHOC in their monograph published in 1937. Important contributions to the theory of chains with complete connections are due to DOEBLIN and FORTET and refer to the period 1937-1940. They consist in the approach of chains with an infinite history (the so-called chains of infinite order) and in the use of methods from functional analysis."

Labor omnia vincit improbus. VIRGIL, Georgica I, 144-145. In the first part of his Theoria combinationis observationum erroribus min- imis obnoxiae, published in 1821, Carl Friedrich Gauss [Gau80, p.10] deduces a Chebyshev-type inequality for a probability density function, when it only has the property that its value always decreases, or at least does l not increase, if the absolute value of x increases . One may therefore conjecture that Gauss is one of the first scientists to use the property of 'single-humpedness' of a probability density function in a meaningful probabilistic context. More than seventy years later, zoologist W.F.R. Weldon was faced with 'double- humpedness'. Indeed, discussing peculiarities of a population of Naples crabs, possi- bly connected to natural selection, he writes to Karl Pearson (E.S. Pearson [Pea78, p.328]): Out of the mouths of babes and sucklings hath He perfected praise! In the last few evenings I have wrestled with a double humped curve, and have overthrown it. Enclosed is the diagram...If you scoff at this, I shall never forgive you. Not only did Pearson not scoff at this bimodal probability density function, he examined it and succeeded in decomposing it into two 'single-humped curves' in his first statistical memoir (Pearson [Pea94]).