Pagano told reporters: "I'm not worried about them, I'm worried about us. Everybody in this locker room is worried about us. The enemy is always in your own camp.
"There's nothing worse than reading your own press clippings, thinking about what you did a year ago, because nobody really cares what happened a year ago.
"This is about 'What have you done for me lately?' So our guys understand that and we will not overlook anybody."
The Colts finished last season with an 11-5 record, but were knocked out of the playoffs in the Wild Card round by the Baltimore Ravens.