The England striker made his first start for over a month in West Ham's 3-1 defeat to Arsenal on Saturday.
Hodgson considered Carroll fit enough to be called up for next week's World Cup qualifiers against San Marino and Poland.
Allardyce told Sky Sports News that he will talk with Hodgson to remind the England boss to watch Carroll's fitness levels carefully.
He said: "Andy is really lacking in match practice. What I will speak to Roy about is his fatigue level.
"Andy will be stiffer than everybody else after this because he hasn't played a full 90 minutes in recent weeks, so he will take a bit more time to recover.
"But he should be fine for Friday and hopefully he will get a game at some stage to improve his match fitness."
Carroll played the full 90 minutes for the Hammers against Arsenal, in only his third appearance for the club since completing a loan move from Liverpool this summer.