The Tigers made a fast start to the game as they forced a goalline drop out and exerted pressure on the home side before Ben Roberts finally found space to crash over the line, with Luke Gale adding the extras.
Castleford crashed over yet again for a try as Oliver Holmes found space in the Hull defence to dive in for a score to hand his side an 18-0 lead.
Hull managed to hit back in the 18th minute when a kick was launched towards the tryline of the visitors and Albert Kelly leaped higher to claim the ball to touch down.
The visitors took advantage of a penalty to move closer to the Hull tryline and Gale finished a fine move with a burst through the line to restore his side's comfortable lead.
Just before the break, Rovers came back into the game as Kieran Dixon collected the ball from a kick and bundled over the line, but failed to convert the extras.
Kelly then recorded his second try of the match as Ken Sio managed to keep the ball in play and offload the ball back to him, before Kelly managed to power through Gale to get over the line.
However, Castleford kept the home side at bay under extreme pressure and edged away in the dying minutes of the match as Liam Finn latched onto a pass from Grant Millington to run in for a try, while Gale added the extras to secure the victory.