Button press with Arduino repeated many times
I can't comment that's why I'm writing this as an answer but,

Are you doing exactly this this to wire the button?


I'd like to see your schematic but from what you describe there's a pull-down connection missing