The 57-year-old has been criticised recently, despite the Hammers lying third in the Championship, four points adrift of Reading in second.
Some fans are said to be unhappy with the style of football that Allardyce has brought to the club.
"Negativity around here has been very much in the forefront recently, which has been strange for me because we have lost one in 12," said Allardyce. "You get opinions about our results like, 'James Tomkins shouldn't be playing in midfield because he is a centre-half.' You get that b*****ks that goes round.
"What happens is I look at the performance of every player and say to everyone who says that, 'You're talking b*****ks.'
"He played in that holding role for three games with 10 men, so that is how short memories people have. That is how much b*****ks is talked about in football. I don't listen to that drivel because what bothers me is that James Tomkins plays well."
Allardyce has been in charge at West Ham since June of last year.