Problem playing large MP4 (500 MB) video files in Android 2.1
Does the .mp4 play as a video on a desktop OS? Can you 'vouch' for the source?

.mp4 is a container format and may well only contain audio, or is corrupt and the player can only salvage the audio...

http://en.wikipedia.org/wiki/MPEG-4_Part_14