Little was penalised for throwing Baltimore Ravens safety Ihedigbo's helmet during his side's win on Sunday, following an incident at the bottom of a pile-up during the first quarter.
"I know the ref was saying to let go of his face mask, but Ihedigbo was choking me, so I'm not going to just let go," Little told The Plain Dealer. "There's a thin line between football and just morals and I'm not going to let a guy spit in my face, choke me and disrespect my family or anything like that.
"I don't have to say anything to the ref. At that point, Ihedigbo has crossed the line.
"Ask [Browns teammate] Phil Taylor if Ray Rice spit in his face again, what would he do? Is he going to pat him on the back?"
With the referee not seeing the wrestling incident, he issued 15 yards for an unsportsmanlike penalty against Little.