Gravity is the reason water is hard to pump uphill. Entropy is why it is hard to separate cream from coffee once they are mixed. "Mixed" has many more micro-states than the whole system had when the cream was in the creamer.
One of my favorite papers of all time is "A New Interpretation of Information Rate" by J.L. Kelly (1957). His co-worker Shannon had already used the word "entropy" in conjunction with information-theory, but was rather embarrassed about it. He considered it a metaphor. Kelly showed how information and probability are intricately linked with entropy. Now the information-theoretical definition of entropy is commonly taken to be the definition.
"Fully half the quotations found on the internet are either mis-attributed, or outright fabrications." - Abraham Lincoln
Want DP delivered to your inbox daily? Subscribe here: