How to use Finder's "Open With Application"?
No, you're not. The Open with Application will do exactly as expected, open whatever file you've chosen with the selected Application. For your weird behaviour, perhaps you double clicked it, or it just bugged somehow and didn't catch the new application as the one it should be open with.