Can't connect to Bitcoind remotely
It turns out that the solution didn't really have anything to do with bitcoind itself - I was running it on a virtual machine hosted on Azure, and I needed to create firewall rules for the port not only on the actual Windows machine, but also in the Azure portal!