The Frenchman is expected to return for the Magpies in Sunday's Premier League fixture against Southampton following a two-week absence with a shin injury.
"We must get ourselves into a better position first," Gouffran told The Chronicle. "But we can look to win things in the future too. It is difficult to talk about success like that.
"But why not in the future go and try to do something in the cups or in a trophy? It would be fantastic for the team and the club. We play football to win things - that's why I came here."
Gouffran has scored one goal in three games for Newcastle following his January move from Bordeaux.