The result sees Everton extend their unbeaten run in the league to nine matches, but Gueye insists that the team are taking things game by game rather than focusing on the possibility of a top-six finish.
"It's not easy because they have a good team and defend well. We have to find a place to score and move the ball well. We have a good team to score. We are happy with the three points," he told reporters.
"My first Premier League goal! I'm happy for the team because the win is the most important thing. The blue shirt is good for me.
"Rom [Lukaku] is a good player and we need him. He can score every time. We play for him and try to give him the ball to score. We just take it game by game, and we will see [about a top-six finish] at the end."
The result leaves Everton just six points off the Champions League places.