Search Results

3 results for “information”

Formulae (3)

H = -\sum_{i=1}^{n} p_i \log_2 p_i

Measures the uncertainty or information content of a distribution.

H = -\sum_i p_i \log_2 p_i

Average information content of a random source (bits).

b = \lceil \log_2(n) \rceil

Minimum number of bits to represent n distinct values.