Shannon entropy for multivariate discrete data
H(px)
px
a vector of positive numbers sum to 1
a non-negative number
H(c(0.5,0.3,0.2))