Meanwhile, Ross County are looking to reach the quarter-finals for the first time since the 2015-16 campaign, when they won the competition.
Sparta scored another four goals past the Scottish side as they did in the reverse fixture, with striker Lukas Julis, who scored a hat-trick in Glasgow, netting a brace which confirmed Celtic's elimination from the Europa League.
The Hoops, who have won just two of their last nine matches in all competitions, are desperate to bring positivity back to Celtic Park and end their miserable run of form.
Celtic do have an impressive record in the Scottish League Cup, having won the competition five times in the previous six years, including their 19th triumph last season, beating Rangers in the final 1-0.
The last time Celtic failed to progress from this stage was back in 2013 when they suffered a surprise 1-0 loss after extra time against Greenock Morton.
Being knocked out of a second tournament in less than a week is something that Lennon cannot afford, especially against a side who have failed to beat them in their last 12 attempts.
Ross County are yet to impress in the top-flight this campaign, but they have done well in the Scottish League Cup - winning all four of their Group D games and scoring more goals than in the league despite playing 11 fewer matches.
The Staggies have won only one of their last 13 Scottish Premiership games and in their most recent they suffered a 3-1 loss to ten-men Kilmarnock last weekend.
Ross County are the last team to win the League Cup aside from Celtic – lifting the trophy in the 2015-16 season – and manager Stuart Kettlewell will be hoping to use that previous cup triumph as motivation when facing Celtic on Sunday.
A surprise victory away from home would be their first at Celtic Park since the 2009-10 campaign when they beat the Hoops 2-0 in this competition.
Celtic form (all competitions): DWLWDL
Ross County Scottish League Cup form: WWWW
Ross County form (all competitions): LLDWWL
Striker Ross C Stewart, who has scored three goals in as many matches in the competition, is set to lead the line once more.
Celtic possible starting lineup:
Bain; Frimpong, Duffy, Ajer, Taylor; Brown, McGregor; Christie, Rogic, Elyounoussi; Ajeti
Ross County possible starting lineup:
Laidlaw; Grivosti, Donaldson, Iacovitti, Reid; Paton, Tillson, Vigurs; Charles-Cook, Gardyne; Stewart
We say: Celtic 4-1 Ross County
With pressure mounting to get results we expect a response from the Hoops as against Motherwell three weeks ago. Ross County have done well so far in this competition, but the quality and desire of Celtic should see Neil Lennon's side win comfortably and confirm their place in the quarter-finals of the Scottish League Cup.