Can I ask a reference letter from someone I met at a place I interviewed?
You can ask the person and there would be no conflict of interest in doing so. While this person might have a good understanding of you research, teaching, and background from the previous job process, they generally will not know you well enough to write a strong letter of recommendation. The best letter writers are people who have known you for years and have worked with you on a daily basis.