(Solved) : Consider Following Messaging System Messages 8 Letter Long Strings Use Alphabet 8 Letters Q27825322 . . . .

Consider the following messaging system. Messages are 8-letterlong strings. They use an    alphabet of 8 letters:{A,B,C,D,E,F,G,H}. Calculate the Entropy H(information measure in bits) of the following messages. Show yourcalculations:

S1 =   AAAAAAAA    H(S1) =

S2 =   AAAABBBB     H(S2) =

S3 =   AABBCCDD     H(S3)=

S4 =   ABCDEFGH    H(S4) =

Compare the entropy of a dice-roll for the fair dice (six-sided)and the fake dice.

Is the entropy of the fake dice greater than or less than theentropy of the fair dice?

Is the entropy of the fair dice greater or less than themaximum entropy of the 8-letter string of 8 letteralphabet?

Expert Answer

An answer will be send