Mathematical Statistics
Mathematical statistics is the application of mathematics to statistics, as opposed to techniques for collecting statistical data. Mathematical techniques which are used for this include mathematical analysis, linear algebra, stochastic analysis, differential equations, and measure-theoretic probability theory.
Probability
Probability is the measure of the likelihood that an event will occur. See glossary of probability and statistics. Probability is quantified as a number between 0 and 1, where, loosely speaking, 0 indicates impossibility and 1 indicates certainty. The higher the probability of an event, the more likely it is that the event will occur. A simple example is the tossing of a fair (unbiased) coin. Since the coin is fair, the two outcomes ("heads" and "tails") are both equally probable; the probability of "heads" equals the probability of "tails"; and since no other outcomes are possible, the probability of either "heads" or "tails" is 1/2 (which could also be written as 0.5 or 50%).
Statistics
Statistics is a branch of mathematics dealing with the collection, analysis, interpretation, presentation, and organization of data. In applying statistics to, for example, a scientific, industrial, or social problem, it is conventional to begin with a statistical population or a statistical model process to be studied. Populations can be diverse topics such as "all people living in a country" or "every atom composing a crystal". Statistics deals with all aspects of data including the planning of data collection in terms of the design of surveys and experiments. See glossary of probability and statistics.
Theory
A theory is a contemplative and rational type of abstract or generalizing thinking, or the results of such thinking. Depending on the context, the results might, for example, include generalized explanations of how nature works. The word has its roots in ancient Greek, but in modern use it has taken on several related meanings.
Probability
This statistical regularity in moral affairs fully establishes their being under the presidency of law. Man is now seen to be an enigma only as an individual; in the mass he is a mathematical problem.
Robert Chambers, Vestiges of the Natural History of Creation (1844).
Statistics
I wish that people would be persuaded that psychological experiments, especially those on the complex functions, are not improved (by large studies); the statistical method gives only mediocre results; some recent examples demonstrate that. The American authors, who love to do things big, often publish experiments that have been conducted on hundreds and thousands of people; they instinctively obey the prejudice that the persuasiveness of a work is proportional to the number of observations. This is only an illusion.
Alfred Binet (1903). L’Etude experimentale de l’intelligence. Paris: Schleicher Freres and Cie. p. 299; As cited in: Carson (1999, 360)
Statistics
While it is easy to lie with statistics, it is even easier to lie without them.
Attributed to Frederick Mosteller in Murray, Charles (2005). "How to Accuse the Other Guy of Lying with Statistics". Statistical Science 20 (3): 239-241. ISSN 0883-4237. Retrieved on 2011-08-22.