Taylor's departure temporarily subdued the excitable atmosphere inside the stadium, but the Toon Army were soon celebrating thanks to the player's replacement Haris Vuckic.
The 20-year-old Slovenia international, who had never previously scored for the Magpies, collected a quick throw-in from Danny Simpson on the right, before cutting inside and finding the net with a deflected volley from 25 yards.
At the other end, Tim Krul needed to be alert to deny Denis Epstein, after the German forward had breached the Newcastle offside trap.
Krul breathed a huge sigh of relief on 43 minutes when, after spilling a long-range effort, he appeared to bring down Chumbinho inside the six-yard box.
With most people expecting to see a penalty kick awarded and a red card shown to the goalkeeper, referee Stephan Studer shocked everyone by booking Chumbinho for an alleged dive.