Presenting a statistical mathematical theory, this work joins the two major lines of development in the field: while British and American statisticians were developing the science of statistical inference, French and Russian probabilitists transformed the classical calculus of probability into a rigorous and pure mathematical theory.