How to display multiple products under each category in a views grid?
In you view page, click Settings under Format section next to Grid or whatever display type you use.
For Grouping field Nr.1 select Content: Category
Under Fields section, click on the field Content: Category
Check Exclude from display
Save. That's it.