The concept of binary description by Ray Solomonoff
Later in page 10 of the pdf he explains that in fact the probabilities are almost 1/2, as there is a very small probability to stop the at each step.

This stems from the following assumption: There is some mechanism that produces these strings, and it does so sequentially, therefore going through shorter strings on its way to longer ones and having a certain probability to stop at each step.

Another explanation that was more satisfying:

These binary strings are in fact prefixes of infinite random sequences. The probability of a prefix to be 1 or 0 is of course 1/2 etc'. The machine that reads these infinite binary strings is a prefix turing machine, which means that if it produces a certain sequence, it does so by reading a prefix of the random string.