where the first and second step follows from the definition of mutual information and conditional entropy respectively. The entropy at the output for a given and fixed input symbol () equals the binary entropy function, which leads to the third line and this can be further simplified.
where the first and second step follows !from the definition of mutual information and conditional entropy respectively. The entropy a:t the output for a given and fixed input symbol () equals the bina.ry entropy function which leads! to the third line and this can be further simplified.