The 29-year-old has gone back to Africa for "personal reasons" after he was initially given extended compassionate leave following the death of his brother in Togo.
Adebayor recently vowed that he will be part of the first team this season, but the ex-Arsenal player may struggle to make that happen due to Roberto Soldado and Jermain Defoe being at Villas-Boas's disposal.
"At the moment, Ade is not with us, because we have granted him authorisation to stay up until Monday in his country for personal reasons, so he's not going to be involved against Norwich [on Saturday]," Sky Sports News quotes Villas-Boas as saying. "Up to when I find it appropriate, he will train with the development team."
Adebayor permanently signed for Spurs from Manchester City last summer.