Oracle - Can't login with "/ as sysdba", but can with "sys as sysdba"
Thanks to @BalazsPapp who pointed this out in the comment to my question.

To use conn / as sysdba, I had to be logged in as the user oracle instead of root.

Switching to the oracle user and attempting to login again solved the problem.