The 27-year-old proclaimed that the Bills would defeat Bill Belichick's side in their two AFC East matches in the 2014 season, but they fell to a 37-22 loss in their first meeting of the campaign on Sunday at Orchard Park.
"I think I talked a lot of trash in the off-season and we weren't able to back it up. That's what hurts me the most," Spikes told reporters. "I pride myself on being a man of my word and it just let the city down. It's just unfortunate.
"We worked so hard in OTAs, the off-season, training camp, just for this game. It was disappointing. Just come out and trip it off like that. They played well. I'll give my hats off to them.
"[Tom] Brady came out and - it don't surprise me. He's a competitor. He's always looking to get better."
The Bills are now 3-3 in their season following their defeat to the Patriots.