Animate mesh size change
You have to create a size keyframe on Frame 1 at size 20. Then when you move to Frame 50, scale it up and add a new keyframe, you'll get the scaling animation working correctly.

In addition, if you want the scaling effect to be more even you can also switch into the Graph Editor and change the keyframe interpolation from Bezier to Linear.