The door at Sweetwaters is located inside, down on the baseboards opposite the counter.
The door at the Peaceable Kingdom is outside, to the right of the entrance, and a small "fairy gift store" is visible inside.