The Magpies ended their seven-game run without a victory in the top flight from the start of the campaign as Gabriel Obertan fired them to a 1-0 win over Leicester City which eased the pressure on Pardew.
"When you haven't won it brings huge pressure," Pardew told the club's official website.
"We've managed to tick that box but there's a lot more boxes to tick for us. But generally I feel a little bit more confidence in and around the camp.
"We've got to improve results, full stop, going forward, and I'll put pressure on myself and put pressure on the team until we do so."
Pardew's side are 18th in the Premier League ahead of their clash with Spurs at White Hart Lane on Sunday.