From his perspective, he knew that wasn't true because they were swimming all around his legs, so he wasn't scaring the fish and they spent their time focusing on that rather than asking the number one best question they could've possibly asked. 