Kullback-Leibler divergence Also known as Relative entropy or Information divergence Inefficiency (or difference in bits) when trying to code using rather than itself Metric? No Not even symmetric Unbounded   Bounded for constrained distributions