Lorient came forward looking for the equaliser but the Reims defence remained solid and limited their hosts to just a series of corners.
Just three minutes after the start of the second half Maxime Barthelme finished well to pull Lorient level.
It was then all Lorient as Kevin Monnet-Paquet and then Ludovic Giuly could not find the target with their efforts.
However, the visitors went ahead for the second time in the 70th minute through a Courtet strike.
Then Pedrinho was found by Jeremie Aliadiere to equalise late on.