The Magpies fell behind in the second half to strikes from Nikica Jelavic and Mohamed Diame, but a brace from Papiss Cisse rescued a draw for the home side to ease the growing pressure on manager Alan Pardew.
Dummett told the club's official website: "It was massive because we knew it was going to be a hard game. We obviously haven't won in the Premier League this season, and there's never any easy game in this league anyway.
"At two goals down there was massive togetherness from the team to pull it back and get a 2-2. One point's better than none, but we're disappointed that we haven't got three."
Newcastle are 18th in the Premier League and winless after five matches this season.