Shola Ameobi's late strike denied Spurs the three points at St James' Park, and Redknapp thought that his side should have finished their opponents off.
"When you're 2-1 up in the 86th minute, you are looking for three points," he told Sky Sports News.
"I felt that we got in a position to finish them off really. At 2-1 I felt very comfortable."
Redknapp was also pragmatic about the groin injury that forced captain Ledley King off.
"When you don't train you're going to get injuries," he added. "That's what happens when you're not training and super-fit."
The White Hart Lane club travel to Blackburn Rovers next Sunday.