Data compression in general is probably a broader problem than can be covered with just one method. I looked up what is called
Kolmogorov complexity. That seems to be a general definition useful for data compression. On the other hand, how the heck to calculate the Kolmogorov complexity for all kinds of information?

Probably very tricky in practice.
Redundancy and/or Uncertainty are still considered as a "white noise" that has to be reduced in order to discover the desired strict information, which is generally considered as the valuable data.
I claim that this is a trivial approach about Complexity, for example:
The rabbit that escapes from the fox, does its best in order produce an unpredictable path during its run, in order to stay alive as a complex system.
This unpredictable path is characterized by high degree of "white noise", which prevents from the fox the strict information that is needed, in order to hunt the rabbit.
This is just one example, which does not follow after Kolmogorov complexity, which is tuned to measure only strings of strict information by reducing the "white noise", as a part of the measurement.
Here is an example of how context is based on connection among text, which enables serial\parallel observation under a one form.
By serial-only observation one can't get, for example,
http://www.internationalskeptics.com/forums/showpost.php?p=6016109&postcount=10078.
Again,
Traditional Math does its job very well, by calculate the amount of a partial case of k-Uncertainty x K-Redundancy tree.
The main thing here is not the "how many?" question, but what actually enables the terms to ask that question?
Since Organic Numbers are a linkage between Non-local and Local qualities, it is the fundamental term that enables Quantity, where Quantity is the basis of the "how many?" question.
"How many?" question is usually based on distinction between different ids that are added to each other in order to define a sum, which is a certain size.
But Non-locality\Locality Linkage is not limited to distinct ids, and in this case the "How many?" question is extended beyond the different ids that are added to each other in order to define a sum.
By this extension the "How many?" question can't capture the complexity of the parallel/serial linkage of k-Uncertainty x k-Redundancy tree, where each part of it is both global AND local case of it, because of the qualitative principle that stands at the basis of Quantity.
k-Uncertainty x k- Redundancy are nothing but finite cases of a one and only one complex ∞-Uncertainty x ∞-Redundancy tree, yet they are based on the same principle of the ∞-Uncertainty x ∞-Redundancy tree, where this principle is the qualitative linkage between Non-locality and Locality.
The reasoning of the past 3,500 did not develop the understanding of the qualitative principle that stands at the basis of Quantity.
Organic Mathematics does exactly this, it discovers the qualitative foundations of Quantity, and step-by-step reasoning can't get that, because a step-by-step reasoning takes Quantity as a fundamental term for its development (by avoiding the understanding of its qualitative foundations) .
This is exactly the reason why Superposition is understood, for example as the sum over histories (
http://en.wikipedia.org/wiki/Path_integral_formulation) of the paths of a quantum element from position A to position B, and by doing that it totally misses the qualitative linkage between Non-locality and Locality, that actually enables this sum, because a sum (which is caused by linear addition of each stimulus individually (see "serial observation" in
http://www.internationalskeptics.com/forums/showpost.php?p=6175451&postcount=10845)) is nothing but some partial case of a framework that also deals with fogs (non-local numbers) and any possible mixture of sums/fogs.
This is also exactly the reason why infinite convergent elements are taken as sums and not as fogs, and this is how words like Superposition or Limit are used without any understanding (where the understanding here is exactly the qualitative foundations of Quantity).