題組內容

3. (24 points) Given a set of probabilities P = [p1, p2, , 61ca6c004fdf7.jpg] for each nonnegative pi ≥ 0, I ≤ i ≤n, and 61ca6c5ca4d80.jpg the (Shannon) entropy is defined by H (P) =61ca6c7f55f75.jpg .

(a) Prove that H (P)≥0.