Tarver made the headlines for the wrong reasons during his side's 21-18 victory over the Pittsburgh Steelers, having been caught showing the middle finger to match officials after a contentious decision.
The 39-year-old has apologised for his actions, and Allen hints that he thought the issue could simply be put down to an emotional reaction in the heat of the moment.
"I don't know if it's one of those things you just say, 'Let's forget about it'. Listen, he's made his statement about what's happened. I think the only thing I'll say is I think he's done an outstanding job with this defence," Allen told reporters.
"I think he's a fiery and emotional guy and I think our players have really taken to that, and I think they've embraced that type of attitude and he has the defence playing at a high level right now."