Frazier also said that current first choice at the position Erin Henderson needs to start behaving like a senior player when other squad members ask for his advice.
"To say that we'd be completely satisfied with where we are depth-wise at the middle linebacker position? I couldn't say that today," Frazier told the Star Tribune.
"We need to see those guys work. This is Erin's first year as a full-time middle linebacker. Audie has never really played a game, other than the pre-season.
"[Defensive coordinator] Alan Williams went up and talked to him about [ignoring a request for advice] and said 'You're in a different role now'. When those guys talk to you, you have to listen and then speak almost as if you're a coach. Otherwise they'll stop asking you questions because they don't want to get in any confrontation."
Henderson made 80 combined tackles for the Vikings in 14 appearances last season.