How can I reproduce this magnification effect for my own screen shots?
In Preview you can now add shadowed magnification. I think this was new in El Capitain. But it is not the same shadow. My guess is that effect is produced in Quartz Composer (if they want to "eat their own dog food").

See interface: