Spurs were stunned 3-0 by West Ham United before the international break, and the German has said that the whole team are targeting three points.
"Everyone who played against West Ham is definitely looking to come back from the result we had," Holtby told reporters.
"I think we're up for it. We must keep it out of our minds, and try to get a win.
"It was vital for everyone, especially after that Russia trip [to Anji Makhachkala in the Europa League], to have a break, to go with the national teams to get some good experience like the Belgium and England lads did."
Spurs beat Villa 4-1 in the League Cup last month.