The Kazakhstan outfit have already beaten BATE Borisov and Skenderbeu Korce to reach the play-off round, and put one foot in the group stages after their success over the 1966-67 European Cup winners at the Astana Arena.
The Scottish champions were guilty of some poor defending and wasting chances and will have a huge task to overturn the deficit in the second leg.
Andrey Finonchenko grabbed the opening goal when he pounced on a loose ball from a long throw in and Sergei Khizhnichenko doubled the advantage in the second half with a close-range header.
Viktor Kumykov made 10 changes to the Karagandy team that beat Astana 2-1 on Saturday, and was clearly keen to focus on the team's Champions League aspirations.
Fraser Forster had been a bystander in the Celtic goal until Karagandy opened the scoring with 12 minutes gone.
The visitors failed to clear their lines from a Nikola Vasiljevic long throw and Finonchenko ghosted in between Joe Ledley and Emile Izaguirre to poke home from close range.
Commons came close to producing a swift response when he unleashed a fierce 25-yard effort that struck the crossbar and bounced on the line before spinning safely into the hands of Mokin.
Karagandy posed a considerable threat in the air and missed a good opportunity to double their advantage when an Aleksandar Simcevic centre was headed off target by Sergei Maliy.
And Celtic should have been level with just under 20 minutes remaining when Forrest timed his run into the box to perfection to meet Izaguirre's curling cross, but he could only head straight at the goalkeeper.
That missed proved costly as Karagandy grabbed a second when more poor defending from Gediminas Vicius' effort led to Khizhnichenko having the simplest of headers from six yards to send the home fans into raptures.
Celtic's hopes now hang by a thread and they will look to overturn the deficit at Celtic Park on August 28.
