A large number of Chelsea fans aired their discontent at the former Liverpool manager taking over from Roberto Di Matteo in November last year.
While the West London outfit are currently third in the Premier League table and have an FA Cup semi-final lined up against Manchester City, plenty of Blues fans continue to display negative banners against the Spaniard during matches.
"I have to say the fans are very good to me in the street," Benitez told Marca. "Many Blues fans stop me and tell me to keep on working and not to listen to the critics. I have a lot more day-to-day support than is shown.
"[The criticism is] not so much. I don't give it any importance. We know there are four or five banners and they repeat them a lot.
"As well as that, this particular group, from the first moment and only because of my past at Liverpool, are against me. They don't criticise my work or the team's play, and I can't change that."
Benitez confirmed earlier on in the season that he will leave Stamford Bridge in the summer.