A black blinking box character on LCD
Looks like the microcontroller is not being properly reset along with the display controller, so that the blinking cursor is being randomly displayed. If it does it in normal operation it is probably bad timing design in the firmware also. 



Better reset hardware design and better firmware design and coding is probably the solution.