User:ThomasW/Notes The Mathematical Theory of Communication

Shannon, Claude E. , Weaver, Warren (1948) The Mathematical Theory of Communication, University of Illinois Press

"It doubtless queer, when one first meets it, that information is defined as the logarithm of the number of choices" p10

"To those who have studied the physical sciences, it is most significant that an entropy-like expression appears in the theory as a measure of information" p 11

Gibbs "The law that entropy always increases- the second law of thermodynamics-holds, I think, the supreme position among the laws of Nature"

"That information be measured by entropy is, after all, natural when we remember that information is communication theory, is associated with the amount of freedom of choice we have in constructing messages." p 12