Intuitively, entropy of a partition is a measure of its information content---the larger the entropy, the larger the information content.