Allardyce believes that the 23-year-old misses out on a lot of free kicks because of his tall height and muscular physique.
"Referees aren't giving him enough free kicks when he is manhandled by central defenders who, let's face it, are having a difficult job coping with the quality that he's got," said Allardyce.
"Because he is 6' 3'', they don't give the free kicks they would perhaps give to the 5' 2''s. Perhaps it's a subconscious thing.
"Andy knows all that. He's been there and has to be patient with it."
Carroll has yet to score in five Premier League matches since he joined the Hammers from Liverpool in August on a season-long loan.