Will Bitcoin Transaction Evicted From Mempool Disappear From Blockchain Explorer?
First of all, there is no "the Bitcoin mempool". Each node has its own mempool, so if the transaction is evicted from one node's mempool, there is no guarantee that it has been evicted from other node's mempools.

If most nodes have evicted a transaction, it still may appear on a blockchain explorer because they may have other configuration settings which has them have a larger mempool and hold onto transactions for longer. Generally blockchain explorers have less restrictive mempool configurations than most nodes, so if a transaction disappears from multiple block explorer's mempools, then it is likely that most nodes on the network have evicted the transaction.