The 23-year-old has been booked three times this season and was forced to be substituted during the side's 2-2 draw with West Bromwich Albion before the international break.
"I feel like they [the referees] are out there for me at the minute," Cattermole said.
"Maybe it's my stupid mistakes in the past that have got me that reputation, so I can't sit here and blame everyone else.
"I have to get rid of that reputation, but it's so hard at the minute when I find myself getting a succession of soft yellow cards."
The midfielder has received 47 bookings and five red cards since 2005.