The London club, who remain in contention for the Champions League trophy as well as the FA Cup, were at the centre of criticism from Arsenal boss Arsene Wenger at the weekend, who claimed that the former Premier League champions were too negative during their stalemate at the Emirates on Saturday.
"What can I say?" Di Matteo said. "From where I'm sitting, we are one point now behind Tottenham, in the final of the FA Cup and semi-final of the Champions League, and we seem to be the worst team in England, you know?
"That's what it feels like sometimes. I'm not going to tell you what I use [to motivate the players]. I'm not saying it's unfair. We respect everybody's opinion."
The Blues take on Barcelona at the Nou Camp tomorrow for the second leg of the Champions League semi-final with a 1-0 advantage.