FFmpeg clarification "position of frame"
I can't say with authority, but it's likely that 'pos' is the byte offset into the file where the frame begins. IOW these aren't frame numbers. In the listing you show the sequence is monotonic, it just doesn't increase by single units. If it is byte offset, it wouldn't start at 0 because there are headers in the file before actual frame data.