Reports have claimed that the England international will not start in tomorrow's Premier League clash against Norwich City following a number of mistakes in goal.
"What we have to be careful of, and we're terrible for it in this country, is getting on somebody's back and destroying their confidence," Clemence told talkSPORT.
"I've seen it happen to Paul Robinson when that ball bounced over his foot in Croatia, and Scott Carson was never forgiven for the Croatia game at Wembley. It just affects them and some don't recover from it. I don't want to see that happen to Joe."