The 32-year-old has been ruled out of the remainder of India's tour of England with ankle and hamstring injuries.
While admitting that Khan's absence is a boost to England's chances for the remainder of the series, opening bowler Anderson believes that his replacement will prove to be more than capable.
"It will be a big loss, he's [Zaheer] the leader of their attack, he's such a skilful bowler, especially in English conditions. He always bowls well here," Anderson told Sky Sports News.
"It is a big loss for them but we can't get carried away with one individual going home because they've got strength in depth and we know that whoever replaces him will have quality and we've got to look to get the better of him."
Khan's injuries are due to keep him out of action for four months.