Relay active low and ESP8266 GPIO pins I am using a ESP8266, specifically the ESP-12-E :

I have a Relay, SRD-05VDC-SL-C connected to GPIO pin 4.
It is wired in Normally Open(with my device to be powered wired into the top and middle pins counting from the top to the bottom of the picture below):

In my arduino code when I issue:
  pinMode(4, OUTPUT);

This seems to pull the pin LOW, which is the active state of the relay, powering it, which turns my device on before my control code has even had chance to run. I want to get the pin for output but keep it floating.
How do I setup my pin for output, but leave it 'floating' from code, or keep it high / floating, so that I have to explicitly issue:
digitalWrite(4, LOW);

Before low is sent to activate my relay?
Hope this makes sense!
The answer thanks to Trevor_G was:

use digitalWrite(4, HIGH); before pinMode(4, OUTPUT);