Statistics and Probability, Problem 7.2 homework help

/in /by

Statistics and Probability, Problem 7.2 homework help

Problem 7.2 Consider an sequence of 8 binary (0 or 1) bits containing only 2 bits that are equal to 1. Assuming each bit is independent of any other and equals 1 with probability s,

a)Find the entropy of the sequence;

b)Is there a single value of s that maximizes the entropy and, if so, what is it?

c)What is the maximum amount of entropy reduction that can occur when you make a guess that one of the bits is equal to 1? Note, your guess can be correct or incorrect.