Arieh Ben-Naim’s defintion of entropy is the number of binary questions one needs to ask to acquire the missing information (about a system).
Source
In Section 3.3, we shall see that the most appropriate interpretation of “entropy” is the number of binary questions that one needs to ask to acquire the missing information. 1
tags:
links: Information Theory