The Magpies claimed their first win of the Premier League season with a 1-0 victory over Leicester on Saturday to end a seven-game winless streak.
Colback now wants Newcastle - who sit 18th in the table - to use that triumph as a springboard toward further wins and earmarks three more points at White Hart Lane.
"Everyone wants to be successful here, and I think we are in a false position," he told The Mirror. "The fans deserve better but hopefully the win can set us off and we can win some more games. We have to build on this.
"We have to focus on Spurs and hopefully get a win there. It is difficult when you are not winning games, really difficult. It can get hard when you are playing out there.
"The fans have stuck with us and we have got the win for them. It has to be a platform to move forward."
Kickoff on Sunday is scheduled for 1.30pm.