how can I identify sidebar blocks in my theme
Check (page.html.twig D8) or (page.tpl.php D7) and check (themename.theme D8) and (template.tpl.php D7)

Worst case scenario, backup first, then start deleting template files one by one and flushing the cache and checking, until you see the one that affects it.