Random Sequence

The concept of a **random sequence** is essential in probability theory and statistics. The concept generally relies on the notion of a sequence of random variables and many statistical discussions begin with the words "let *X*_{1},...,*X _{n}* be independent random variables...". Yet as D. H. Lehmer stated in 1951: "A random sequence is a vague notion... in which each term is unpredictable to the uninitiated and whose digits pass a certain number of tests traditional with statisticians".

Axiomatic probability theory *deliberately* avoids a definition of a random sequence.^{[2]} Traditional probability theory does not state if a specific sequence is random, but generally proceeds to discuss the properties of random variables and stochastic sequences assuming some definition of randomness. The Bourbaki school considered the statement "let us consider a random sequence" an abuse of language.^{[3]}

Émile Borel was one of the first mathematicians to formally address randomness in 1909.^{[4]} In 1919 Richard von Mises gave the first definition of algorithmic randomness, which was inspired by the law of large numbers, although he used the term *collective* rather than random sequence. Using the concept of the impossibility of a gambling system, von Mises defined an infinite sequence of zeros and ones as random if it is not biased by having the *frequency stability property* i.e. the frequency of zeros goes to 1/2 and every sub-sequence we can select from it by a "proper" method of selection is also not biased.^{[5]}

The sub-sequence selection criterion imposed by von Mises is important, because although 0101010101... is not biased, by selecting the odd positions, we get 000000... which is not random. Von Mises never totally formalized his definition of a proper selection rule for sub-sequences, but in 1940 Alonzo Church defined it as any recursive function which having read the first N elements of the sequence decides if it wants to select element number N+1. Church was a pioneer in the field of computable functions, and the definition he made relied on the Church Turing Thesis for computability.^{[6]} This definition is often called *Mises-Church randomness*.

During the 20th century various technical approaches to defining random sequences were developed and now three distinct paradigms can be identified. In the mid 1960s, A. N. Kolmogorov and D. W. Loveland independently proposed a more permissive selection rule.^{[7]}^{[8]} In their view Church's recursive function definition was too restrictive in that it read the elements in order. Instead they proposed a rule based on a partially computable process which having read *any* N elements of the sequence, decides if it wants to select another element which has not been read yet. This definition is often called *Kolmogorov-Loveland stochasticity*. But this method was considered too weak by Alexander Shen who showed that there is a Kolmogorov-Loveland stochastic sequence which does not conform to the general notion of randomness.

In 1966 Per Martin-Löf introduced a new notion which is now generally considered the most satisfactory notion of algorithmic randomness. His original definition involved measure theory, but it was later shown that it can be expressed in terms of Kolmogorov complexity. Kolmogorov's definition of a random string was that it is random if has no description shorter than itself via a universal Turing machine.^{[9]}

Three basic paradigms for dealing with random sequences have now emerged:^{[10]}

- The
*frequency / measure-theoretic*approach. This approach started with the work of Richard von Mises and Alonzo Church. In the 1960s Per Martin-Löf noticed that the sets coding such frequency-based stochastic properties are a special kind of measure zero sets, and that a more general and smooth definition can be obtained by considering all effectively measure zero sets.

- The

- The
*complexity / compressibility*approach. This paradigm was championed by A. N. Kolmogorov along with contributions Levin and Gregory Chaitin. For finite random sequences, Kolmogorov defined the "randomness" as the entropy, i.e. Kolmogorov complexity, of a string of length K of zeros and ones as the closeness of its entropy to K, i.e. if the complexity of the string is close to K it is very random and if the complexity is far below K, it is not so random.

- The

- The
*predictability*approach. This paradigm was due to Claus P. Schnorr and uses a slightly different definition of constructive martingales than martingales used in traditional probability theory.^{[11]}Schnorr showed how the existence of a selective betting strategy implied the existence of a selection rule for a biased sub-sequence. If one only requires a recursive martingale to succeed on a sequence instead of constructively succeeds on a sequence, then one gets the recursively randomness concepts. Yongge Wang showed^{[12]}^{[13]}that recursively randomness concept is different from Schnorr's randomness concepts.

- The

In most cases, theorems relating the three paradigms (often equivalence) have been proven.^{[14]}

It is important to realize that for each of the definitions given above for infinite sequences, if one adds a billion zeros to the front of the random sequence the new sequence will still be considered random. Hence any application of these concepts to practical problems needs to be performed with care.^{[15]}

- Randomness
- History of randomness
- Random number generator
- Seven states of randomness
- Statistical randomness

- Sergio B. Volchan
*What Is a Random Sequence?*The American Mathematical Monthly, Vol. 109, 2002, pp. 46-63

**^**"What is meant by the word Random" in*Mathematics and common sense*by Philip J. Davis 2006 ISBN 1-56881-270-1 pages 180-182**^***Inevitable Randomness in Discrete Mathematics*by József Beck 2009 ISBN 0-8218-4756-2 page 44**^***Algorithms: main ideas and applications*by Vladimir Andreevich Uspenski?, Alekse?, L?vovich Semenov 1993 Springer ISBN 0-7923-2210-X page 166**^**E. Borel,*Les probabilites denombrables et leurs applications arithmetique*Rend. Circ. Mat. Palermo 27 (1909) 247-271**^**Laurant Bienvenu "Kolmogorov Loveland Stochastocity" in STACS 2007: 24th Annual Symposium on Theoretical Aspects of Computer Science by Wolfgang Thomas ISBN 3-540-70917-7 page 260**^**Church, Alonzo (1940). "On the Concept of Random Sequence".*Bull. Amer. Math. Soc*.**46**: 130-136. doi:10.1090/S0002-9904-1940-07154-X.**^**A. N. Kolmogorov,*Three approaches to the quantitative definition of information*Problems of Information and Transmission, 1(1):1--7, 1965.**^**D.W. Loveland,*A new interpretation of von Mises' concept of random sequence*Z. Math. Logik Grundlagen Math 12 (1966) 279-294**^***An introduction to Kolmogorov complexity and its applications*by Ming Li, P. M. B. Vitányi 1997 0387948686 pages 149-151**^**R. Downey,*Some Recent Progress in Algorithmic Randomness*in Mathematical foundations of computer science 2004: by Ji?í Fiala, Václav Koubek 2004 ISBN 3-540-22823-3 page 44**^**Schnorr, C. P. (1971). "A unified approach to the definition of a random sequence".*Mathematical Systems Theory*.**5**(3): 246-258. doi:10.1007/bf01694181.**^**Yongge Wang: Randomness and Complexity. PhD Thesis, 1996. http://webpages.uncc.edu/yonwang/papers/IPL97.pdf**^**Wang, Yongge (1999). "A separation of two randomness concepts".*Information Processing Letters*.**69**(3): 115-118. doi:10.1016/S0020-0190(98)00202-6.**^**Wolfgan Merkel,*Kolmogorov Loveland Stochasticity*in Automata, languages and programming: 29th international colloquium, ICALP 2002, by Peter Widmayer et al. ISBN 3-540-43864-5 page 391**^***Algorithms: main ideas and applications*by Vladimir Andreevich Uspenski?, Alekse?, L?vovich Semenov 1993 Springer ISBN 0-7923-2210-X page 176

- Hazewinkel, Michiel, ed. (2001) [1994], "Random sequence",
*Encyclopedia of Mathematics*, Springer Science+Business Media B.V. / Kluwer Academic Publishers, ISBN 978-1-55608-010-4 - Video on frequency stability. Why humans can't "guess" randomly
- Randomness tests by Terry Ritter

This article uses material from the Wikipedia page available here. It is released under the Creative Commons Attribution-Share-Alike License 3.0.

What We've Done

Led Digital Marketing Efforts of Top 500 e-Retailers.

Worked with Top Brands at Leading Agencies.

Successfully Managed Over $50 million in Digital Ad Spend.

Developed Strategies and Processes that Enabled Brands to Grow During an Economic Downturn.

Taught Advanced Internet Marketing Strategies at the graduate level.

Manage research, learning and skills at defaultlogic.com. Create an account using LinkedIn to manage and organize your omni-channel knowledge. defaultlogic.com is like a shopping cart for information -- helping you to save, discuss and share.