Diouf has been involved in a number of controversial incidents since moving to English football in 2002, including spitting at opponents and fans and allegedly taunting Jamie Mackie while the player was on the floor with a broken leg.
However, the 30-year-old believes that the incidents he has been involved in are minor ones compared to misdemeanors committed by other players.
"I have done things but others have done worse. I am an easy target, people talk about me no matter what. Okay, I have hurt people and I regret that. But I have never been to prison, I have never injured anyone on the pitch," said the former Senegal international.
"After people gave me the 'bad-boy' image, I had to deal with it. Bad boy? It makes me laugh.
"It doesn't bother me. I prefer that people talk about me, whether good or bad. I leave my mark wherever I go."