The hosts had the first sighting of goal when Papiss Cisse collected the ball on the edge of the area, only to send his shot just past the post.
Spurs began to take control of the match, and were unlucky not to take the lead when Jermain Defoe advanced into the penalty box and unleashed an effort that came back off the post.
The visitors began the second half the way they had finished the first, but it was Newcastle who took the lead against the run of play when Demba Ba fired a fine effort into the top corner.
Newcastle manager Alan Pardew was then sent to the stands after appearing to push the linesman for not awarding his side a throw-in, and Spurs took full advantage of the confusion.
The Magpies were soon back ahead, however, as Hatem Ben Arfa was brought down in the box before stepping up and firing his spot kick past Brad Friedel. Spurs pushed on for another equaliser but couldn't find a way through as Newcastle ran out 2-1 winners.