ffmpeg adds unneeded zero samples at beginning of resulting m4a file
I have seen this also with libfdk_aac and x264 and am not sure what causes it but I have had success using the itsoffset flag like this:

ffmpeg -itsoffset 0.046440 -i original.wav -c:a libfdk_aac -vbr 5 ffmpeg.m4a