Hide fiberglass insulation in ceiling next to stone wall
The simplest solution here would be plywood. It would be easy to cut into the shapes you need (which are mostly rectangular) and then screw to the bottom of the joists. If you want to cover by the stones, consider caulk, but I think the plywood would suffice here.