Posted by: atri | September 14, 2007

## Lecture 8: Shannon’s noise model

Today we looked at the way Shannon modeled the noise stochastically (that is also memory-less) and looked at the notions of capacity and error correction (in stochastic models). We defined the specific channels: $BEC_{p},qSC_{p},BEC_{\alpha}$ and $BIAWGN_{\sigma}$. Finally we stated Shannon’s capacity theorem for $BSC_p$.

In the next lecture we will prove the expressions that relate the entropy function to the volume of a Hamming ball and then move on to the proof of Shannon’s capacity theorem (for $BSC_p$).