query: How can they come up with the definition of entropy in information theory?
positive_passages.docid: 153720
positive_passages.text: Intuitive explanation of entropy
negative_passages.docid: 65789
negative_passages.text: Independence of thermodynamic variables
negative_passages.docid: 156125
negative_passages.text: Clear up confusion about the meaning of entropy
negative_passages.docid: 105342
negative_passages.text: How did Planck arrive at the idea that energy is quantized?
negative_passages.docid: 37209
negative_passages.text: Quantum information references
negative_passages.docid: 52755
negative_passages.text: Rewriting the probability density function as a probability function
negative_passages.docid: 98993
negative_passages.text: What keeps draining entropy?
negative_passages.docid: 58627
negative_passages.text: Entropy of the multivariate Gaussian
negative_passages.docid: 75817
negative_passages.text: Why does the Coarse-grained Entropy increase?
negative_passages.docid: 37028
negative_passages.text: Thermodynamics and the state postulate: should it be a Fourth Law?
negative_passages.docid: 133605
negative_passages.text: A word that describes both "encoding" and "decoding"?
negative_passages.docid: 41888
negative_passages.text: How to prove that permutation and substitution ciphers satisfy H(X) = H(Y) in Shanon Entropy?
negative_passages.docid: 62737
negative_passages.text: Intuition behind measurable random variables and $\sigma$-algebra
negative_passages.docid: 92839
negative_passages.text: Problem about entropy
negative_passages.docid: 123941
negative_passages.text: Maximum theoretical data density
negative_passages.docid: 46363
negative_passages.text: Shannon confusion and diffusion concept
negative_passages.docid: 71490
negative_passages.text: Is there any use for the quantity $\int f(x)^2 dx$ in statistics or information theory?