Example: I will buy fish only if I shop at the pier

Does the placement of the "only" make the sentence ambiguous so that multiple readings of this sentence is possible?

Which word is "only" modifying?