Does mouse poison attract mice?
No you shouldn't.

If you put animal bait there, a stray rodent might find its way in there and perhaps die, which would cause a stinky problem after a few days. If you did a sufficient job sealing up the area with spray foam, the problem shouldn't come back!