The quarterback signed a contract extension last week that will keep him with the franchise until 2017, when he will be 40.
The owner of the Patriots told Sports Illustrated: "The contract we have with Tom Brady is a real contract we will both live by. I was probably wearing my fan hat as much as anything else.
"If Tom Brady played out this current contract and left us, there was no doubt in my mind that someone out there would pay him top dollar, and they should, for his ability, his leadership and his unselfishness."
Brady has won three Super Bowls since being drafted by the side in 2000.