Additional characters when I press longer
This "feature" has been around for a few years.  See if this helps:

https://www.macobserver.com/tmo/article/os_x_lion_using_and_disabling_the_character_picker