After winning three games on the spin Scotland could draw against Slovenia and still potentially finish second but, with one of the nine runners-up set to miss out on a qualification playoff spot, Bannan is only interested in another victory.
"Thursday was win-or-bust and Sunday will be the same," Sky Sports News quotes him as saying. "But these are the games that make you want to play football. It's been a while since the fans had something to cheer about so it was great we were able to send them home happy on Thursday.
"You saw the scenes at the end. That was probably the happiest moment I've had in football - now let's hope we can top it that on Sunday night by beating Slovenia over there."
Scotland are second on 17 points, leaving them two better off than Slovakia and three in front of Slovenia.