You can refinance with a Federal Housing Administration (FHA) loan with just 3.5% in home equity, but be aware that you will need to pay mortgage insurance with all FHA loans. Most FHA insurance must be paid for the entire loan term.