"Draining" concrete blocks?
Is there a good way to find out, and possibly drain this water out? 


A drill with a concrete bit should do the trick. 


  Will a dehumidifier work in this situation?


A basement in most climates (any place with somewhat humid summers) should likely have a dehumidifier regardless. So it definitely won't hurt.