The Spurs manager came under criticism after the side's heavy defeat to Manchester City but Holtby, who scored the winner on Wednesday night against Fulham, said that result was the players' fault and not AVB's.
"We are sticking together," Sky Sports News quotes Holtby as saying. "We are not discussing things that are happening outside - that is not our job.
"Our job is to get points to win games and make the fans happy. That is our main objective.
"We have to do our talking on the pitch. We were responsible for that disaster at Manchester City but the way we responded after that has been good. We have to carry on doing that."
The result at Craven Cottage lifted Spurs into sixth.