Ireland, who have slipped to 59th in the FIFA rankings following a poor run that saw previous manager Giovanni Trapattoni sacked, triumphed courtesy of goals from captain Robbie Keane and defender John O'Shea, with a late Dmitriy Shomko own goal adding gloss in Dublin.
They trailed in the early stages after Shomko's stunning strike from distance but Keane scored from the penalty spot – his 61st goal for his country in 130 appearances – to level proceedings in the 17th minute.
O'Shea then punished Kazakhstan goalkeeper Andrey Sidelnikov for spilling a header with his first goal in more than 10 years for Ireland before Shomko turned into his net in the latter stages as Ireland won just their second World Cup qualifier of the year.
Keane recovered from an ankle injury to headline four changes made by interim Ireland manager Noel King, who also handed Andy Reid his first international appearance in almost six years and recalled O'Shea and Richard Dunne after suspensions.
Keane had the game's first chance in the ninth minute and although his flick header was tame, Sidelnikov fumbled it in a sign of things to come.
The visitors should have taken the lead moments later, only for Maxat Baizhanov to put a free header over the bar, but their frustration did not last long thanks to Shomko's brilliant effort.
The goalkeeper flapped at a Dunne header following another innocuous Reid corner and O'Shea reacted quickest, hooking into the net from close range with his left foot.
The first half petered out following Darron Gibson's knee injury, which forced him off on a stretcher after a fall.
