The 25-year-old defender, who is on loan at Molineux from Tottenham Hotspur, was shown red in the early stages of Wolves' 3-0 defeat to Arsenal on Wednesday.
While the club have accepted the ban, Connor has admitted that he has a "beef" with the punishment.
"I do have a beef, if you like, with what happened afterwards in terms of giving Sebastien a red card when there was absolutely no intention from either player to foul one another.
"It was a tangle of legs and I accept a penalty being given, that's the referees prerogative, but to send him off. I didnt think that fit the crime."
Connor has only managed to claim one point with his Wolves team since replacing Mick McCarthy on a temporary basis.