How to make special French keyboard characters work in MS RDC?
In windows symbols can be inserted by pressing Shift + relevant number key to insert symbol.

When using a macbook on Microsoft Remote Desktop connection, you are required to Hold down Cmd + Shift + Number Key.  

This is the hidden option for inserting symbols into Windows machines over Microsoft Remote Desktop Connection.