How to remove video streams from .wmv with FFmpeg?
Apparently, I needed to specify pcm_s16le as the audio codec. Other files (not in the snippet from the question) where using aac, .wmv required me to specify otherwise.