The 59-year-old, who has been the club's mascot Gent for almost 20 years, has dropped seven stone, prompting club officials to ask Berry to wear a fat suit, which he declined.
"I'm absolutely gutted," the Daily Star quotes Berry as saying. "I am a grown man and this is something I have cried over. I've been through the Bradford City fire. I've been through everything down there.
"I don't want the club getting hurt. I love the club. If you cut me open I'd be claret and amber. It's not the team and it's not the club, but I am disappointed with the way it's been dealt with."
Berry was told that he could not attend charity events or give young mascots match-day tours.