When I applied Armature Modifier, Mesh does not follow the animation
The answer is fairly simple, don't apply the armature modifier.

Once a modifier is applied, it cannot dynamically change the mesh. Applying a modifier simply takes the current effects of the modifier an applies them permanently to the mesh. This is rarely useful for the armature modifier, as generally you want to keep animating the mesh.