Eric Dier scored a late winner as Spurs secured a 1-0 success over West Ham United at Upton Park, and Kaboul has revealed his delight at the response to losing Kyle Naughton to a red card in the first half of the meeting with their London rivals.
"There is nothing better than this feeling," the defender told the club's official website. "I'm glad, delighted.
"It wasn't easy. We were under pressure after going down to 10 men, that's normal, but we dealt with it. Then, when they had a player sent off, it was equal and we had more of the ball and were in control.
"You could see when Eric was going through on goal that he believed in what he was doing and we're all delighted for him. It was a great moment and a great start for us."
Spurs return to action against AEL Limassol in the Europa League on Thursday night.