Installed Boost Caching, but now my dynamic blocks and webforms are also cached
It seems you  check Cache blocks(block caching) in config/development/performance. 
Try to uncheck that. When you work with Boosts it is not require use that feature.