The Baggies currently sit third in the Premier League and remain undefeated after beating Liverpool and Everton as well as drawing at Tottenham Hotspur.
Albion had not earned a single point at this stage of last season but Long still remains cautious despite taking seven points from nine.
"We're not getting carried away. We haven't achieved anything as yet. We're confident in our ability," said Long.
"The international break means we can relax a bit with seven points under our belts. Obviously it's a great start but we've another 30 or 40 points to get before we're happy. And home points are good because we relied on our away form a bit last year.
"The manager certainly didn't need a bad start so it's pleasing for him. It's all about having confidence in ourselves and he's instilled that into us from the start."
Long is one of 14 Albion players away on international duty.