The striker, who is currently on loan from Liverpool, has failed to score in all 11 of his appearances for the Hammers this season.
"I think he's a little frustrated by it but that's the issue," said Allardyce.
"I don't think frustration helps you. I think you like to come, start and get off the mark as quickly as you possibly can.
"So we have got to keep providing the service and eventually he'll start putting it in the net, we hope."
Carroll is expected to feature for West Ham when they take on Premier League champions Manchester City at Upton Park on Saturday.