The Foxes overcame Sheffield United to reach the last 16 last week, but now head into another testing Premier League clash against Stoke City having previously been beaten by Manchester City last time out.
"It was very disappointing day for us (the defeat to City) and, even though we came up against probably the best team in the Premier League this season, we still expect better of ourselves," Morgan told the club's official website.
"It's about putting that behind us and the only way we can do that is by getting a positive result in our next game against Stoke and we want to show what we can do."
"It's pretty tight and we don't want to look too far ahead. We'll keep going as we are, we'll keep picking up points and we'll see where we are at the end of the season. All we can do is our job, keep winning games, keep picking up points because there are not many games left between now and May."
Leicester currently occupy eighth place in the standings with 35 points from 27 games.