Evans, who was making his first start of the campaign, has admitted that United are desperate to win the cup.
"We want to win it. It was the first trophy I won and it was a great feeling to win it then," Evans told Sky Sports News. "It's a competition we want to win, we will be taking it seriously. I think the fans enjoyed it, we certainly enjoyed it.
"It was a hard game, Liverpool have been playing expansive football. I am just glad we got the goal after half time and held on.
"They put out a strong team. There were a lot of lads out there who haven't had a lot of football and were getting a bit tired towards the end."
United will host Norwich City in the fourth round of the tournament.