Absolute black shadow takes forever to render with custom shadow catcher node
I managed to fix the issue with this node set. Basically it says "just don't render this area if camera rays hit it" or something like that. I don't know I am bad at answering questions but if you have the same issue, try replicating this nodeset and maybe it will help you. It helped in my situation at least.