SQLPlus: Cmd vs PowerShell
Arg, found the problem. My username is ops$account and PowerShell treats $ as a start of variable token. Because $account was null the username I was passing was just "ops". I fixed the issue by escaping the $ with the backtick, i.e.

C:\oracle\client\BIN\sqlplus.exe ops`$account@server