When should I give up on hearing back from a potential PhD supervisor?
It might have just slipped through the cracks. Politely follow up and let him know that his position is your first choice. Include whatever attachments you sent the first time so that he doesn't have to hunt for them. If you don't hear back in a few days, move on.