How to change or transfer mailing list groups properly?
Since folks who have already unsubscribed aren't in the smart group, I would simply search for members of the smart group, add them to group "Events and Invitations", add them to group "Monthly E-Newsletter", and delete the smart group.