How to remove database from explorer after deleting .MDF and .ldf files
Are you attempting this with SSMS? I followed this process using SSMS v18.4:

Take DB offline
Manually delete mdf and ldf files.
Right click on database in SSMS and click 'Delete'.

This worked just fine for me.