The Hammers have won only one of their last nine matches and were booed off the pitch following yesterday's goalless draw at home against Sunderland.
"It doesn't make it easier for me, but it is part of the job," the 59-year-old told Sky Sports News.
"You sit there and you expect that reaction when your team doesn't perform. We didn't entertain them and, more importantly at the moment, we didn't win."
Allardyce takes his team to White Hart Lane on Wednesday for a League Cup quarter-final clash with Tottenham Hotspur.