Remove screwdriver tip from screw hole
Have you tried a strong magnet? Most of my drivers that use those small bits hold them in place with a magnet so the bit becomes magnetic. A strong magnet may take it right out where shaking won’t.