The North East side welcome the Swans to St James' Park tomorrow following their recent disruption in the campaign when they lost 1-0 to West Ham United last weekend.
"We need to bounce back and it is a good opportunity with it being a home game to put some points on the board," Simpson told the club's official website.
"We've got to start better against Swansea. We have to start quickly and try to get the first goal, rather than starting when they score first. They've got different threats to West Ham. They are more technical and want to play quicker football but that will suit us, I think."