Masonry screws won't engage in brick or mortar?
Be sure you're using the right size drill. If you are then your mortar/brick material might not be suitable for tapcons. As critical as railings are, I'd suggest lag shields and lag bolts. I've always used the stainless steel lag bolts for outdoors but galvanized are available too.