“Structure->Block” showing when permission is not given to user
You've probably given them the Administer blocks and Administer views permission as well. Withdraw these permissions and the links should disappear.