The U.S. government obtained a perpetual lease that began on February 23 , 1903 . A perpetual lease for the area around GuantÃ namo Bay was offered February 23 , 1903 , from TomÃ s Estrada Palma , the first President of Cuba .