Brechin Vics made the long journey to Fife on Saturday in the hope to get back to winning ways.
They got off to the worst possible start when, after 10 minutes Gauld was red carded for preventing a goal scoring opportunity.
Kirkcaldy had their tails up and Robbie had to produce a good diving save in the 15th minutes.
Robbie again was called into action five minutes later, saving well from a header from 12 yards out.
The 10-men of Vics were by no means out of the game and were looking dangerous, although their final ball was lacking.
Kirkcaldy went ahead after 25 minutes when a headed flick on played Robertson in on goal, and he coolly slotted the ball past the advancing Robbie.
Vics came more into the game after this and Lewis was causing the Kirkcaldy defence problems and it was from one of his runs that created the equaliser in the 35th minutes when he was upended in the box and a penalty kick was awarded.
Whitworth stepped up and sent the goalkeeper the wrong way from the spot kick.
Half-time: Kirkcaldy YM 1, Brechin Vics 1.The second half was very much bogged down in the middle of the park with flowing football very difficult on an uneven playing surface.
Vics were looking dangerous on the counter with Whitworth causing the Kirkcaldy defence problems in the air.
Renilson had a good run down the right but his centre failed to pick out its intended target.
Despite being down to 10-men for the bulk of the game, Vics were battling bravely and were rewarded in the 75th minute when Lewis cut in from the left and fired a low shot into the corner of the net from 18 yards.
Kirkcaldy came back at Vics and equalised after 82 minutes when a cross created a scramble in the box before Kinninmonth slammed the ball into the net from eight yards.
Vics were not happy to settle for a draw however and scored what proved to be the winner on 86 minutes when an S. Eaton free kick found Whitworth, who scored at the second attempt slotting the ball into the net from six yards.
A club spokesperson said: “Vics showed a real hunger and desire to secure the three points.
“After being down to 10 men for 80 minutes of the match their battling qualities and team work was exceptional.”
Vics are at home this Saturday (March 7), when they will welcome East Craigie to Victoria Park. Kick off is at 2.30 p.m.
Team: Robbie, S. Eaton, Milne, Stephen, Gauld, Ross. Renilson, Steel, Whitworth, Strachan and Lewis. Subs: Gourlay, Cargill, King, McKay and O’Neil (gk).