Azure SQL Database "Login failed for user" in application, but works fine in SSMS
We found that with contained databases / contained users you must specify:

GRANT CONNECT TO [YOUR_USER]


Otherwise CONNECT seems to be revoked by default. Once we made the above change, we could access the database.