Despite the shock decision, the Brumbies player has backed the new skipper to succeed.
"It's just the way it goes. I mean it's in the nature of the sport, it's just part and parcel of it,” Elsom said.
"I don't know if 'disappointed' is the right term, but I think it is what it is and we've just got to get on with it.
"Kevvy's [Horwill] done a great job for us in the short time he's been back this year, he's been pretty solid the whole season. Everyone in the side wants the same thing and we're pushing very hard for that."
The full Wallabies squad will head to Brisbane on Sunday in preparation for their Tri-Nations meeting with the All Blacks on August 27.