Papiss Cisse has scored three times during injury time during the last month, securing wins for Sunderland's local rivals.
The Black Cats' goalkeeper told Sky Sports News: "They have scored a couple of goals in the last minute, we know that, so let's make sure we stay on our toes until the last whistle is blown.
"Let's hope we can now make sure we can get a clean sheet. That would be one part of the job done already, and then we will make sure we score a couple of goals."
Sunderland have not kept a clean sheet during their last eight matches.