The format itself is proprietary spec (ISO), there are open source implementations to read and write MP4 video files, e.g. in VLC. Using MP4 requires licenses due to patents owned by companies who created the MP4 format.