A five-wicket haul ensured that Australia wrapped up the series 2-0 this week but Clarke insists that the team still have a lot of improving to do.
Clarke said: "We as players don't consider ourselves as the number one Test team but we know that is a goal we're working to.
"I think we're ranked third now, so I still think we're a way off that. We need a lot of improvement to become the number one team.
"It's not just about one series or one summer - it's consistency that gets you to be the number one ranking."
Australia have lost just one of their last nine Test matches.