Australia, who have suspended four players from their third Test in India for disciplinary reasons, will face Alastair Cook's side in back-to-back Ashes series later this year.
"It's not passed us by," Prior told BBC Sport. "But it is not something that we are interested in at all. We've got a huge Test match coming up."
England are currently in New Zealand where they will face the hosts in the second Test on Wednesday.