Laplace (Yes, that Laplace):
Quote:
...we regard as extraordinary those classes [of events] which include a very small number. In the game of heads and tails, if heads comes up a hundred times in a row then this appears to us extraordinary, because the almost infinite number of combinations that can arise in a hundred throws are divided in regular sequences, or those in which we observe a rule that is easy to grasp, and in irregular sequences, that are incomparably more numerous.
*Note: when he wrote
divided, he meant "scattered and sparse", as with "united we stand, divided we fall". Yes, I'm also slightly mystified by his judicious use of the comma.
Quote:
If you actually got that, any statistician would conclude that the coin is not fair, precisely because the probability of getting it if the coin was fair is so tiny.
More Laplace:
Quote:
The regular combinations occur more rarely only because they are less numerous. If we seek a cause wherever we perceive symmetry, it is not that we regard the symmetrical event as less possible than the others, but, since this event ought to be the effect of a regular cause or that of chance, the first of these suppositions is more probable than the second.
On a table we see letters arranged in this order: Constantinople, and we judge that this arrangement is not the result of chance, not because it is less possible than the others...but this word being in use among us [in our language], it is comparably more probable that some person has thus arranged the aforesaid letters than that this arrangement is due to chance.
Remember that the probability of getting a million heads in a row is the same as the probability of getting any other specific combination of a million heads and tails, the only difference for a million heads in a row is the human semantic impression that it is somehow "special".
In the language example: when we see the words
Constantinople on the table, we presuppose that somebody must have intentionally arranged them as such, rather than the word appearing out of a random shuffling: simply because the word
Constantinople is in the popular English language. Had the word
Xpiayoc appeared, we would be more convinced that this is a nonsense word generated by random shuffling, although somebody from the ancient Mayan civilization would disagree:
http://en.wikipedia.org/wiki/Mayan_gods