© Getty Images
Having taken just one point from their three previous Group A outings, Turkey went into tonight's clash knowing that victory was a must to maintain any hope of reaching the finals.
The visitors looked to be struggling and it seemed only a matter of time before Turkey edged ahead - and they did on 26 minutes.
Yilmaz went down in the area under a challenge from Renat Abdulin, before the Galatasaray hitman dispatched the resulting penalty.
It was two just three minutes later, as Yilmaz took aim from just outside the box and watched his modest shot squeeze past Aleksandr Mokin before creeping over the line.
Turkey continued to threaten what would have been a killer third goal, and found one with seven minutes remaining as Aziz glanced Gokhan Tore's cross home for his first international goal.
Samat Smakov converted a late penalty for Kazakhstan, but it was soon rendered a mere consolation by the full-time whistle.