The boys had their first chart success with their debut single `` Please Go '' , recorded in 1965 . Initially a pop rock band with Frans Krassenburg as lead singer , Golden Earrings had their first chart success with their debut single `` Please Go '' , recorded in 1965 .