The absurd consequences of neglecting structure but using the concept of order just the same are evident if one examines the present terminology of information theory.

Entropy theory is indeed a first attempt to deal with global form; but it has not been dealing with structure. All it says is that a large sum of elements may have properties not found in a smaller sample of them.

Entropy theory, on the other hand, is not concerned with the probability of succession in a series of items but with the overall distribution of kinds of items in a given arrangement.

Rudolf Arnheim Quotes