The 32-year-old was forced to pull out of the bout after suffering a cut in sparring eight days before the fight.
"I've heard all the conspiracy theories," he told Sky Sports News. "They've been quite funny; headbutting walls and getting people to do this and do that. But to consider the conspiracies is a bit of a joke.
"It's really annoying because I didn't anticipate to think about Tyson Fury over Christmas, New Year or even 2014. The whole Tyson Fury chapter was going to be closed, well and truly on Saturday night, about a round-and-a-half into the fight.
"The Tyson Fury hype was going to be completely finished and we'd never really had spoken of him again. But now we've got to listen to this idiot, the guy continuously rant on with his stupid comments. I'll try not to let him ruin my Christmas!"
The bout has been rescheduled for February 8.