Is there a way to allow use of unconfirmed RBF outputs in transaction building?
Bitcoin Core will happily spend RBF marked inputs it doesn't avoid them much less prohibit them.

Perhaps you're being confused by the fact that it will not spend an unconfirmed input created by a third party? Or maybe you have spendzeroconfchange set off or only have long-chain unspents?