Transferring files using ssh on terminal
Have you tried, while logged on to Computer A :

scp (Computer B user)@(Computer B address):/Users/(Computer B user)/Desktop/(file_name) ~/Desktop/


It's more explicit than using ~, which may not behave as you might want it to on the remote machine - although it will be fine for local file specifications.