Sturridge nets on debut as Liverpool progress
Swansea City and Arsenal had earlier drawn 2-2 in a dramatic match at the Liberty Stadium that featured a lightning strike from substitute Michu and a dramatic three-goal flurry in the final 10 minutes.
Sturridge, signed from European champions Chelsea, took just seven minutes to open his account on a rutted Mansfield pitch that looked more like a mudfield in places.
Suarez, who replaced the England striker in the 55th minute, made it 2-0 after just four minutes on the pitch but the goal triggered accusations of cheating after television replays showed the ball had hit his hand.
Liverpool manager Brendan Rodgers, however, played down the incident.
"There's no doubt it was handball," he told ESPN television of a goal that proved to be the winner. "Obviously what the referee and officials were looking at was that it wasn't deliberate, which it clearly wasn't."
Neutrals hoping for a magical upset, in a David and Goliath clash typical of the world's oldest knockout competition, were given hope when Matt Green pulled one back for the Stags in the 79th and Liverpool faltered.
The game ended with Liverpool under pressure, Green having a shot turned away in stoppage time and Exodus Geohaghon rattling the visitors with his immense throw-ins.
Swansea's big Spaniard Michu made an instant impact 58 minutes into the game against Arsenal when he netted 73 seconds after coming off the bench to chants of "he scores when he wants to" from a spirited Welsh crowd.
It was his third goal against Arsenal this season, after scoring twice at Emirates Stadium in the Premier League last month.
Arsenal, without any silverware since 2005 and determined not to let their best remaining chance of the season slip through their fingers after a slow-burning start, equalised through substitute Lukas Podolski in the 81st.
Kieran Gibbs then put the visitors 2-1 up with a volley two minutes later.
The Arsenal fans' elation was short-lived, however, with Danny Graham grabbing an equaliser from close range in the 87th in a frenetic final few minutes during which either side could have produced a winner.
Arsenal's Theo Walcott had the ball in the net but was ruled offside, while team-mate Laurent Koscielny fired over the bar on the rebound from a Michel Vorm save. A 51st-minute penalty claim by Arsenal also fell on deaf ears.
"A replay wasn't exactly what I was hoping for, especially with the two League Cup games against Chelsea in mind and the league games coming up," said Swansea manager Michael Laudrup. "It's a very tight schedule. But a replay is better than a defeat."
Arsenal manager Arsene Wenger said his side should have won and questioned referee Howard Webb's decision.
"It was a penalty. The referee didn't give it because he thought it wasn't deliberate, but Aaron [Ramsey] didn't trip himself. He was clipped by the Swansea player," he said.
The winners of the replay at Emirates Stadium will face Championship giantkillers Brighton and Hove Albion, who humbled Premier League Newcastle United on Saturday, in the fourth round.
Holders and European champions Chelsea, who thrashed Southampton 5-1 on Saturday, face lower division opponents Southend United or Brentford in the next round. Liverpool now play third-tier Oldham Athletic.
League champions Manchester City travel to second-tier Crystal Palace or Premier League rivals Stoke City depending on the outcome of a replay.
Leaders Manchester United, who drew 2-2 with West Ham United on Saturday, have the prospect of a home game against Premier League Fulham or second-tier Blackpool if they win their replay at Old Trafford.
Non-league Luton Town were rewarded for their 1-0 win over Championship Wolverhampton Wanderers, who sacked Norwegian manager Stale Solbakken hours later, with a visit to Premier League Norwich City.