However, that changed when referee Mike Dean gave Torres a second yellow card 10 minutes from time for an alleged elbow.
Vertonghen went to ground holding his face, but replays showed that the Spaniard's arm did not make contact with Belgian's head.
"I dont think it was [a fair result]," Mourinho told BT Sport. "They were better than us in the first half. They didn't created so many chances, but they deserved to be leading 1-0.
"In the second half there was only one team and that team was very strong.
"But then the referee makes a big mistake and the game changes. I don't think the referee is to blame, I think you have to blame Vertonghen."
Torres and Vertonghen clashed on numerous occasions throughout the game at White Hart Lane.
The Chelsea man's first booking came following an incident that saw him clip Vertonghen's heels before scratching his face.