The match pitted two former Premier League stalwarts up against each other as ex-Chelsea defender William Gallas was tasked with marking Jets' 62-time capped England striker Emile Heskey.
Following a goalless first half, it was Heskey's side who took the lead just after the hour mark when A-League top scorer Taggart netted past Jack Duncan to continue his prolific season.
However, Marinkovic equalised on 84 minutes, and it took veteran forward Harold only 90 seconds to follow suit as Perth extended their unbeaten run over Newcastle to 12 matches.
They are now level on points with Melbourne Heart in the table, with both teams having collected 25 points from as many games. Newcastle remain in seventh and are in contention for a spot in the finals.