James Vaughan scored the only goal of the game as the Terriers eased their relegation worries by securing the three points at Turf Moor.
"It is a brilliant, an absolutely brilliant feeling. I think we deserved it – and could have had a few more goals," Robins told the club's official website.
"We have got a lot of work on to get playing the way that I want the team to play; but what I have got is a bunch of players who are workman like and have a never-say-die attitude."
Huddersfield are now 18th in the Championship and are six points clear of the relegation zone.