Pardew saw his side pick up their first Premier League win of the season last weekend against Leicester City, but they fell behind to an early Emmanuel Adebayor goal at White Hart Lane.
However, Sammy Ameobi made an instant impact by equalising seven seconds after his introduction at the start of the second half, and fellow substitute Remy Cabella laid on Ayoze Perez's maiden Newcastle goal to complete an impressive fightback.
Mauricio Pochettino recalled Adebayor at the expense of Roberto Soldado and the decision paid off when the Togo international headed the opener after 18 minutes.
Tottenham were then stunned as Ameobi fired home from Jack Colback's long ball to register his first top-flight goal for Newcastle, before Ayoze - who moved to St James' Park from Spanish second-tier side Tenerife in the close-season - achieved the same feat when he nodded in Cabella's floated delivery.
While Spurs threatened late on, they were ultimately made to pay for their profligacy in the first half as they lost a third league game at home this term, with Pardew left to reflect on a hugely positive outing that sees Newcastle escape the bottom three.
Daryl Janmaat gave Newcastle an early scare after three minutes when he appeared to handle the ball inside the area following positive play down the left from Nacer Chadli.
Referee Anthony Taylor pointed for a corner before Adebayor helped lay on an opportunity that saw Christian Eriksen volley wide as the hosts began the brighter.
Paul Dummett fired Newcastle's first chance of the game over the crossbar 14 minutes in and Spurs' pressure then reaped rewards as Adebayor nodded in his first club goal since August.
The visiting defence initially did well to block a shot from Danny Rose and Eriksen's follow-up but, at the third attempt, Ryan Mason clipped in a cross for Adebayor to convert.
Spurs continued to dominate possession, albeit while struggling to create any further clear-cut chances, and the visitors were perhaps fortunate to go in at the break trailing by just one goal.
However, all Spurs' positive play in the first half was undone within seconds of the restart as Colback's diagonal ball caught the hosts off guard.
With Eric Dier cut out of the picture, Ameobi kept his cool to find the bottom-right corner and draw Newcastle level in sensational fashion.
An effort from Eriksen rolled marginally wide following a deflection off Fabricio Coloccini as Spurs sought to get back in front but it was another Newcastle substitute who helped craft the winning goal.
Cabella curled a delightful delivery in from the left that Ayoze was able to nod home as Newcastle completed what had seemed a most unlikely comeback.
Spurs replacement Harry Kane failed to get in on the act, spurning a great opportunity following Rose's delivery from the left, as Newcastle survived a late onslaught to win at White Hart Lane for a second season running.
