The now-Potters attacker was at the centre of controversy when Wanderers manager Nuno Espirito Santo signed him from Bournemouth for £10m, only to find himself shown the door less than a fortnight later.
"People are thinking Wolves were under an obligation to sign me. They weren't," Afobe told the Birmingham Mail. "Four days later, my agent told me, 'The manager wants to bring in a few strikers and isn't going to play you'.
"It was disrespectful. I've got a baby daughter and a heavily pregnant wife. The last thing we needed was to be messed about. Everywhere I went, football fans would ask about it and I've had to justify myself to not look stupid."
Afobe bagged six goals in seven starts while on loan at Molineux from the Cherries in the second half of the last campaign.