I read that Bitcoin addresses are single-use tokens. Is it my responsibility to generate new ones in Electrum?
Generally you do not need to manage your addresses yourself. Your wallet software will handle that for you and generate new addresses for you when you want to receive Bitcoin. In Electrum, just use the receive tab and get addresses from there. As you use addresses, you should see that the address in the "receiving address" box should change.