I dug holes for my pergola too wide
Not to big of a concern. 

You could take a 12" sono tube, slice it length wise and then pull it open enough to get it around the post. Then just overlap the slice and glue it with outdoor construction adhesive.

Once the glue sets you can back fill around the outside of the tube with soil, keeping it plumb and straight, and then you are ready to fill with concrete.