Inserting a ❤ symbol into text
If you're on Windows try selecting the font "MS Mincho" (it should be  C:\Windows\Fonts\MSMINCHO.TTF). Or MS Gothic (msgothic.ttc), this is how Libreoffice Writer gets it.

At least that font is used on my Microsoft Word (on Windows 7) when I paste your char into a blank document. I tried setting both the above on Blender, and it works: