However, there was still time for Fabian Delph to secure the victory for his team with a long range strike.
Below, Sports Mole takes a look at the key talking points from the game.
On target 9
On target 3
Was the result fair?
Southampton deserved at least a draw from this game but they were punished for some defensive mistakes. The home side enjoyed 77% possession but somehow that wasn't enough to secure the win over a stubborn Villa team, who stuck to their plan impressively.
Mauricio Pochettino has certainly seen his team play better this season, despite the match statistics proving the hosts were dominant for most of the game. A team that has looked so assured at the back this campaign will be furious to know that all three of the goals conceded could have been avoided. Delph's winner was a superb striker but the amount of space he was gifted will keep Pochettino up tonight.
The joy on Paul Lambert's face at the end of the game was clear for everyone to see tonight. Villa made the trip with a clear gameplan in mind as they frustrated the home team with their refusal to get caught out by committing too many players forward. Delph was superb in midfield, while Gabriel Agbonlahor was always a threat on the break when Villa did advance further up the pitch.
Sports Mole's man of the match
Fabian Delph: The former Leeds United midfielder is proving this season why he received so much attention when he made the move to the Premier League. It was a tough night for the visitors, who were forced to watch the home team keep the ball for long spells. However, when Delph was on the ball he used it impressively and his energy levels in midfield were crucial as Villa secured the victory.
Southampton were on top after Jay Rodriguez had equalised for the hosts but they were soon put on the back foot following a mistake from Jack Cork. The substitute should have cleared while under pressure from Karim El Ahmadi but the Villa midfielder managed to steal the ball and pick out Kozak, who headed the visitors 2-1 up.
Jonathan Mason didn't have too many big decisions to make tonight but he probably should have given a penalty when Ciaran Clark tripped Osvaldo inside the box.
Southampton: The Saints will be looking to avoid a fourth defeat in a row when they host Manchester City on Saturday.
Villa: Lambert's side return to action on Sunday when they travel to London to face Fulham.