Carroll has played just once since joining on loan from Liverpool but put in a man of the match performance before picking up a hamstring injury.
In his absence, Carlton Cole has been leading the line for the Hammers and Nolan is relishing the chance for the pair to play together.
"You are always going to miss quality players," said Nolan.
"But at the end of the day we have got another top quality player in Carlton Cole, who has come in and done a very good job. He was unlucky not to be on the scoresheet.
"It is going to be quite interesting when we have them both fit to see if we can play both of them, because they would scare the life out of defenders."
West Ham host Wigan Athletic in the Capital One Cup on Tuesday night.