A potential PhD supervisor wants me to visit campus for an interview before I know if I'm accepted
The solution here is honesty and candor. You should explain that you would like to visit the campus, but that your financial situation doesn't allow it at the moment. Any reasonable person would either drop the suggestion of a campus visit, or find some money to pay for your travel expenses. Any other reaction would be a red flag.