The 25-year-old left Oakwell last week to join Wolves, with Flitcroft claiming that the defender was not fully committed during his final weeks with at club.
"If the manager is saying that, then I don't agree," Golbourne told the Barnsley Chronicle. "I told him it would probably take me 10 games to get back to the form I was in before I got injured last season.
"I don't think I was outstanding in the last few weeks but I think I did a job. We didn't perform well as a team, it wasn't just me. I was on the left wing a lot which is not where I prefer to play."
Golbourne made 53 appearances for Barnsley.