Message Entropy (H)= -∑i(piLog2(pi)). where pi is the frequency of each character. For Example: Message: AC P(A) = 0.5 P(C) = 0.5 H(AC) = - log(P(A)) * P(A) / log(2) - log(P(C)) * P(C) / log(2) H(AC) = 1