The Swans, who won the competition back in 2013, make the trip to Anfield with a place in the fifth round of the competition at stake.
Following Saturday's 2-0 win over Leicester City in the Premier League, Carroll has warned Liverpool that Swansea will be travelling to Merseyside looking to come away with a victory.
"Tuesday is another big game for us," he told the club's official website. "It was a good performance from the lads on Saturday to get the win. We didn't really get it going as much in the second half, but overall we deserved the win and it was nice to get back to winning ways.
"Playing against Liverpool at Anfield is always a tough ask, but we are confident and looking forward to it. They haven't quite got going as well as they did last season but they have great players and I'm sure they will click soon."
Saturday's victory over Leicester saw Swansea move up to sixth place in the Premier League table.