ffmpeg -to option acting like -t option?
Yes, it does. -to looks at the timestamps. And input ss resets them to zero from the seek point. Either use -ss as output option (after -i) or calculate and use duration -t. The former will slow operation, as it performs a slow seek (decode and discard till inpoint).