lot of bitcoinj clients have connected to me
If their IP addresses are all 52.*, then they're lying about being BitcoinJ and are really attacking you / the network. If so, ban them. If their IPs are all different, it's fine.