Samsung Galaxy emitting constant beeping sound
After further investigation, the issue turned out to be that a card with an NFC chip was interacting with the NFC receiver in the phone.

While there were no open applications, this still caused a constant beep every few seconds. Removing the card, or disabling the NFC, both solved the issue.