Does difficulty adjustment apply when you mine in secret?
Yes. The difficulty adjustment is part of the consensus rules. In order to create a valid chain that you intend to use to replace the current main chain, you must follow all of the consensus rules. That means adjusting the difficulty in the same way any verifier would be when they validate your chain.