City's victory moved them up to second place in the standings, three points behind leaders Chelsea with two games in hand, but Kompany has insisted that his side still have work to do to reach the top of the table.
The 27-year-old told Sky Sports News: "It's just one little step. The other teams are still very good. Games have to be played. As long as we don't have the points, I don't consider ourselves there yet.
"With the game against Arsenal, obviously it's good in a way, because you don't have to make a big effort to get the lads focused again."
Kompany has made 20 Premier League appearances for the Citizens during the current campaign.