Solubility Of Benzoic Acid
I would guess that benzoic acid forms dimers or trimers connected by hydrogen bonds in nonpolar solvents. To the outside, these only show the phenyl rings.

The colligative properties of those solutions would clearly show how many individual particles they contain. I´ll leave the literature research for you. ;)