SD Card and Sony Xperia E3
NO,It will not harm your phone

Since, operating speed of SD is less than SDHC.Data transfer will occur at same rate which is supported by your mobile phone.
So it will not harm your phone.