The 69-year-old's Premier League rival, however, believes that Olympic Team GB football manager Stuart Pearce should be permitted to "decide freely" on the players that he wants to include in the squad.
"Stuart has to decide freely on what he wants," said Villas-Boas. "It can collide with clubs' interests for sure.
"Not everyone has this stance of respect for Olympic competition, but I have.
"Everybody should be proud to represent their country in the Olympics, which is a very special event."
The Football Association has hinted that they could be open to players taking part in both tournaments.