 Louisville also had to contend with Confederate prisoners.Located at the corner of Green Street and 5th Street, the Union Army Prison, also called the "Louisville Military Prison", took over the old "Medical College building.