Spurs advanced to the fourth round of the Capital One Cup on Tuesday night after easing past Aston Villa 4-0 at Villa Park.
However, Holtby believes that Tottenham are capable of tasting success in more than one competition this term.
"Silverware is silverware. There's four cups to play for and you want to win all of them," Holtby told the media.
"If you want to go to the top as a professional footballer you try to win every game and you try to win every trophy.
"That's what we are trying to do and we just have to work like we have as a team the last couple of weeks. We have a big chance of winning something but it is a very long season."
Spurs will host Hull City in the next stage of the tournament.