Conventional loans: For a 3% down payment, you'll need at least a 620 FICO and a debt-to-income ratio below 50%. The higher your credit score or the lower your debt, the better your chances are for approval. FHA loans: If you want a down payment as low as 3.5%, you'll need a FICO score of 580 or higher.