How to split,reverse and concatenate video using single command in FFMPEG?
If you want to concat the videos in the same order they were in, but with the individual videos reversed, I think you've already found the best way and there would not be a one liner.
If you concat the videos, and then reverse it, it would look like this:
ffmpeg -f concat -safe 0 -i mylist.txt -c copy pipe: | ffmpeg -i pipe: -vf reverse reversed.mp4
Sources:

https://trac.ffmpeg.org/wiki/Concatenate

https://stackoverflow.com/questions/45899585/pipe-input-in-to-ffmpeg#comment99663597_45902691

How to use FFmpeg Command for Reverse Video?