Consider a discrete memoryless channel and assume that H(x) is the amount of information per symbol at the input of the channel; H(y) is the amount of…
Consider a discrete memoryless channel and assume that H(x) is the amount of information per symbol at the input of the channel; H(y) is the amount of information per symbol at the output of the channel; H(x|y) is the amount of uncertainty remaining on x knowing y; and I(x; y) is the information transmission. Which of the following does not define the channel capacity of a discrete memoryless channel?
Show answerHide answer
Correct answer: (D) max over p(x) of H(x|y)
Explanation
The channel capacity of a discrete memoryless channel is defined by C = max over p(x) of I(x; y) = max over p(x) of [H(y) – H(y|x)] = max over p(x) of [H(x) – H(x|y)]. max H(x|y) does not define the channel capacity.