The Canaries are now just three points above the relegation zone following today's result at Carrow Road.
"I'm annoyed and frustrated because there was no way we should have lost or deserved to lose," Hughton told BBC Sport.
"We were the better side over 90 minutes, but Villa have pace on the counter-attack and we have conceded two poor goals today."
"Joe Bennett shouldn't have been on the park - he was on a yellow card when he conceded the penalty and had two or three fouls after that," he added.
"I find it incredible that he was still on the park."
Norwich welcome West Bromwich Albion to Carrow Road next Sunday.