The victory was the club's first in nine Premier League games, and Guzan is adamant that winning matches is the only thing that Villa care about.
"At the end of the day it was about getting three points and for us it didn't matter if it was pretty or not and so for us, however it came, three points were the most important thing today," Guzan told talkSPORT.
"We know there is a lot of football to be played in this season still so we enjoy the win today, it was important to get three points, but at the same time we have to look ahead. We have a big game in two weeks [against Manchester City] and we'll start preparing for that right away.
"When things aren't going your way you continue to fight and find a way to pick up results and hopefully we can pick up results and build on this today and continue to move forward."
Villa travel to Arsenal in their next game on February 23.