Barker took charge of the former Premier League side this week after departing Crawley, but he has claimed that his former players are not in his immediate thoughts.
Barker told reporters: "Will I go back? No. These players here deserve the opportunity to stay here and do the right things. If they do the right things they will get the opportunity to stay.
"Shaun Cooper was with me at Crawley and Trevor Carson came through at Bury so there are two players here I have worked with before."
Portsmouth currently sit 17th in League Two.