Gipson hit Finley in the head at the end of a 10-yard reception, forcing him off the field with a neck injury after undergoing six minutes of treatment on the pitch.
The 23-year-old was penalised for unnecessary roughness after the referee ruled that he had lead with the helmet, but Gipson insists that it was a legitimate shoulder tackle.
"[It was] all shoulder. The crown of my head did not go down whatsoever. It was a shoulder hit. I don't know the place where it hit him exactly. I just know I saw him break out of the middle," ESPN quotes Gipson as saying.
"He was running a slant. I'm driving on the ball. There's a collision and he's down. I really haven't watched the play so I can't really tell you what happened. I was just going out there playing physical."
The Browns went on to lose the game 31-13.