The two Glasgow clubs have not played each other since April 2012 as a result of Rangers' demotion to Scottish League Two ahead of the 2012-13 season.
The manager told ITV Sport: "We would love to play Rangers. Everybody is waiting for an Old Firm game and that's what we want.
"It is a big game. I haven't seen so much of Rangers so we will see if the game does come. The League Cup is very important, it is the first trophy we can win and we are going to go for it.
"Cup finals are unbelievable and that is why I am here, to win trophies and to develop the team in the right way."
Celtic face Hearts in the third round on Wednesday, while Rangers take on Falkirk tomorrow.