Referee Simon Barrow went down with an injury in the ninth minute at a rainy and blustery Plainmoor, and was eventually replaced by one of his assistants.
Both teams struggled to get into their rhythm after a long delay, but the game sprang into life thanks to a 25th-minute strike from Gulls skipper Aman Verma - his second goal of the season.
The Gulls nearly doubled their lead when Brett Williams' header from Luke Young's corner crashed against the crossbar.
Guiseley's hopes of salvaging anything from the game were dealt a severe blow 10 minutes into the second half when Jake Lawlor received a second yellow card for a late challenge on Dan Sparkes.
But they equalised in fortunate circumstances when a long ball struck the shoulder of Jake Cassidy who kept his composure to steer the ball home.
And the West Yorkshire side clinched the points 11 minutes from time when Will Hatfield controlled a long punt from goalkeeper Jonny Maxted before guiding the ball past Brendan Moore.
Match report supplied by the Press Association.
Match ends, Torquay United 1, Guiseley 2.
Second Half ends, Torquay United 1, Guiseley 2.
Substitution, Guiseley. Javan Vidal replaces Will Hatfield.
Jon Maxted (Guiseley) is shown the yellow card.
Substitution, Torquay United. Ruairi Keating replaces Jamie Reid.
Dan Sparkes (Torquay United) is shown the yellow card.
Substitution, Guiseley. Adam Boyes replaces Jake Cassidy.
Substitution, Torquay United. Sam Chaney replaces Lathanial Rowe-Turner.
Goal!  Torquay United 1, Guiseley 2. Will Hatfield (Guiseley).
Substitution, Torquay United. Shaun Harrad replaces Damon Lathrope.
Goal!  Torquay United 1, Guiseley 1. Jake Cassidy (Guiseley).
Substitution, Guiseley. Ashley Palmer replaces Jordan Preston.
Second yellow card to Jake Lawlor (Guiseley) for a bad foul.
Second Half begins Torquay United 1, Guiseley 0.
First Half ends, Torquay United 1, Guiseley 0.
Jake Lawlor (Guiseley) is shown the yellow card.
Goal!  Torquay United 1, Guiseley 0. Aman Verma (Torquay United).
First Half begins.
Lineups are announced and players are warming up.
Ten-man Guiseley staged a remarkable comeback to secure victory and keep Torquay mired in the relegation zone.