Search Results

1 result for “information theory”

Formulae (1)

D_{KL}(P\Vert Q)=\sum_i P(i)\log\dfrac{P(i)}{Q(i)}

Measures how one probability distribution differs from a reference distribution.