3. (24 points) Given a set of probabilities P = [p1, p2, , ] for each nonnegative pi ≥ 0, I ≤ i ≤n, and the (Shannon) entropy is defined by H (P) = .