Stephen Curry was the standout performer with 33 points, as the Clippers fell short at the Oracle Arena in their Game Four encounter.
"Whatever the distractions, I gotta do a better job," Rivers admitted after the game.
"I didn't do my job tonight. I take that personally. It's my job as a coach to get them ready, and I just didn't feel like I did the right stuff."
The sides will meet again for Game Five in Los Angeles on Tuesday.