Issues surrounding Gerrard's future at Anfield dominated the build-up to Tuesday's match - where the former England skipper reverted to an advanced midfield role and scored the vital second goal for the visitors.
Leicester took a 22nd-minute lead when Liverpool goalkeeper Simon Mignolet, who turned in another nervy performance, was unfortunate to have Leonardo Ulloa's shot ricochet off him and into the net.
Adam Lallana restored parity shortly afterwards and Brendan Rodgers' side were ahead when their skipper Gerrard - left out of the starting XI against Stoke City last Saturday - made no mistake with a calm finish after 54 minutes.
And Jordan Henderson converted from close range after a mistake from Leicester keeper Kasper Schmeichel, and a superb backheel from the outstanding Raheem Sterling, with seven minutes to go to ensure Liverpool made it back-to-back top-flight wins for only the second time this season.
Schmeichel's opposite number Mignolet was almost left red faced in the 19th minute when he inexplicably cleared straight to Esteban Cambiasso but the veteran Argentine midfielder side-footed wide of an open goal from 30 yards.
Liverpool responded immediately, though, and equalised four minutes after going behind - Lallana reacting quickest to drill a low shot past Schmeichel when Morgan failed to head clear under pressure from Lambert.
Alberto Moreno replaced Manquillo for the second-half, allowing Liverpool's weekend match-winner Glen Johnson to revert to his customary position of right-back.
Leicester pinned Liverpool back having won a pair of corners inside the opening minute of the second half but another botched clearance from the hapless Morgan saw the visitors go in front.
The centre-back stretched to divert Sterling's cutback away from goal but he could only place the ball into the path of Gerrard, who clinically steered home side-footed.
Ulloa blasted off target as Leicester looked to hit back, but Morgan's miserable evening was complete in the 63rd minute when he scuffed a backpass and responded by hauling down Lambert when through on goal to earn his marching orders.
But Liverpool's nerves were eased when Schmeichel failed to deal with a low Gerrard cross and Sterling teed up Henderson to mark his 150th appearance for the club with a simple finish.
