Spurs are currently in ninth place in the Premier League table after taking seven points from their opening five games of the campaign.
The North-London club suffered a second home defeat of the season on Sunday when they were beaten by West Bromwich Albion, but Pochettino is confident that his players will soon improve.
"It's always different when you arrive at a new club with different players and you need time to get to know each other," the Argentine is quoted as saying by Sky Sports News. "I'm not worrying about the situation. I believe at the moment we need to have more points to reflect the table.
"It's the beginning of the season. It's not how we start it's how we finish. We are sure our team will improve not only in how we play but in the results over the next few weeks."
Tottenham return to action on Wednesday when they host Nottingham Forest in the third round of the League Cup.