Miller double settles Old Firm derby
Champions Rangers were 2-0 up after a Kenny Miller double when midfielder Zheng was brought down by Sasa Papac for a penalty in the 25th minute.
Aiden McGeady whipped in a knee-high spot-kick which keeper Allan McGregor managed to get a hand on but could not stop.
Zheng, who was released by Charlton Athletic at the end of last season, had little chance to shine in the frenetic and hostile atmosphere of the Glasgow derby match before 50,276 fans.
Rangers started strongly and Miller, a former Celtic striker, was released through the middle by Kris Boyd to clip a low shot away from keeper Artur Boruc from 15 metres and into the net after eight minutes.
Miller made it 2-0 eight minutes later as he shrugged off Celtic defender Glenn Loovens inside the box to smash a shot into the right side of the net from 12 metres.
The 29-year-old Zheng's debut was called to a halt after 70 minutes when he was replaced by Paddy McCourt.
Rangers' triumph moved them second top in the SPL with 15 points from seven games, a point behind leaders Celtic.