In the center of Bury St Edmunds there is the remains of an abbey , surrounded by the Abbey Gardens , a park . In the center of Bury St Edmunds lie the remains of an abbey , surrounded by the Abbey Gardens , a park .