
The entropy concept was developed and used by Shannon in 1940 as a measure of uncertainty in the context of information theory. In 1957 Jaynes made use of Shannon's entropy concept as a basis for estimation and inference in problems that are ill-suited for traditional statistical...