Fournier said that they would have to "fight tooth and nail" but sees the ability within the squad to pick up enough points.
"There's more calmness and confidence within the squad now," Fournier told Ligue1.com.
"We know that if we continue to stick away our chances and fight tooth and nail for every ball defensively that we'll pick up points and be capable of staying up.
"We were missing a few players against Saint-Etienne and those who were on the field proved we can count on them."
Reims travel to high-flying Nice on Friday night.