Postgres 9.4 won't accept remote connections
With your edit, you are probably running something like this, which will default to the user postgres:

psql -h 123.123.123 -d mydb


when you should be using the user flag:

psql -h 123.123.123 -d mydb -U whoever


you will be prompted for the password for user whoever.