The most obvious reason why it is a bad idea to pull money out of your TSP is that you lose the gains the money would have generated had it remained diversified in the TSP. ... The TSP charges you the G fund rate at the time of your loan, which remains fixed. You pay this rate back to yourself.