SSRS minimal permission to download reports
At the end, just so that I don't need to download the reports for them to edit, I have granted a very selective AD group with the contents manager permission, so that they can do their work.

any better alternative please post an answer or comment, I will review the situation accordingly.