The differences Between Federal Prison and State Prison. Federal prison is where people who have committed federal crimes or have been accused of violating federal laws are incarcerated. State Prison is where people who have violated or have been accused of violating state laws are incarcerated.