User:ThomasW/Notes The Mathematical Theory of Communication: Difference between revisions
(Created page with "Shannon, Claude E. , Weaver, Warren (1948) The Mathematical Theory of Communication, University of Illinois Press "It doubtless queer, when one first meets it, that informati...") |
(No difference)
|
Latest revision as of 14:30, 18 May 2016
Shannon, Claude E. , Weaver, Warren (1948) The Mathematical Theory of Communication, University of Illinois Press
"It doubtless queer, when one first meets it, that information is defined as the logarithm of the number of choices" p10
"To those who have studied the physical sciences, it is most significant that an entropy-like expression appears in the theory as a measure of information" p 11
Gibbs "The law that entropy always increases- the second law of thermodynamics-holds, I think, the supreme position among the laws of Nature"
"That information be measured by entropy is, after all, natural when we remember that information is communication theory, is associated with the amount of freedom of choice we have in constructing messages." p 12