Why is Bloom Effect affecting the whole scene
Play around with the Bloom settings in the Render Tab. You'll get the required effect.

For more details, please share an Image which can clarify the question.