Specify Minimum Font Size in Safari 10.0, macOS Sierra
use 

defaults write com.apple.Safari com.apple.Safari.ContentPageGroupIdentifier.WebKit2MinimumFontSize -int 14


… restart Safari, be happy again! (replace 14 with whatever suits you)

edit: as OP said, paste the line into terminal, sorry for omitting this initially!