The Manchester United man has dominated the headlines in the build-up to the Three Lions' must-win clash with Uruguay on Thursday, and Lampard believes that onlookers need to "drop the agenda" against any single player.
"Unfortunately we do have a fixation with one player during every World Cup, ones that I've been involved in," Lampard told reporters.
"It's a bit frustrating when you're in a team group and that happens because we're there trying to play together - people are not selfish in this squad - trying to get results and a fixation with one player can become, rather than a debate, a bit of an agenda.
"So I do think we need to drop the agenda and look at the team, whoever plays, because the manager will pick the best team that he sees fit and whoever plays we want to win the game."
Lampard was an unused substitute during the defeat to Italy at the weekend and is unlikely to start again on Thursday.