The Championship side had the majority of the possession from the start, but it was 35 minutes before they managed to break the deadlock, with Duane Holmes beating an offside trap before firing the ball in low.
Wayne Brooksby had a chance to get the home side back on level terms shortly before the break, but the Guiseley midfielder curled the ball well over.
Huddersfield soon doubled their lead after the break as Holmes pulled the ball back for Harry Bunn to smash past the keeper.
However, the home side got themselves back into the game just after the hour mark with a clinical finish from Adam Boyes following a strong spell of possession by Guiseley.
Bunn continued to prove a threat as full time approached, testing the keeper with a 25-yard drive that narrowly missed the post.