If I am using DRY lube, do I need to clean my chain between applications?
Yes you should clean the chain occasionally.  Where does the dirt go if you don't clean it off ?

True that dry lubricants are not as sticky as wet ones, but there's still dirt there and it needs to come off, not get further into your chain's gubbins.