Dejan Lovren was caught out by a high ball over the top for the opening goal, while the Croatian centre-back was also at fault for the second eight minutes later.
Klopp replaced Lovren with 31 minutes on the clock and admits that Liverpool were simply not good enough at the back in North London.
"The whole game, the whole result was all our fault - Tottenham was good, they needed to be good, but we made it much too easy for them," he told Sky Sports News. "The first goal was a little throw in and we are not really there. It was just really bad, bad, bad defending.
"The second, a counter-attack, when the ball passes Dejan Lovren it is already too late. Coming back in the game with the goal we had our chances, but it's nothing to talk about today. The third one, it's a completely open situation.
"We make the foul, again, all our fault. The fourth - second ball and third ball for Tottenham, their desire was bigger than ours. The game was finished then. We came here for a result and had not one second to get a result."
Liverpool have now conceded 16 goals in the Premier League this season - the sixth-worst record in the division.