Using FFmpeg or other libraries on an ARM SoC without OS layer?
That is of course possible, BUT ...

that ffmpeg code will likely make some library functions (reading bloks of data from the mpeg file?) that would be provided by the OS. In a non-OS ('bare metal') situation you must somehow provide those functions.