Zimmer snapped Brady's streak of 52 consecutive games with a passing touchdown, and held his offense to just six points when he was defensive coordinator of the Cincinnati Bengals in their win over Bill Belichick's side.
However, the 58-year-old feels that it will be much different this time around when the Vikings take on the Patriots on Sunday.
"You know it was a different team, different situation," Zimmer told reporters. "It rained like crazy the last minute of the ball game.
"It's completely different. Obviously you look at the tape but you don't think that everything is going to be the same."
The Vikings beat the St Louis Rams in their season opener last week.