Pulis quit as Palace manager just two days before the start of this season after keeping them in the top flight last term, and the Welshman marked his first game back at his former club with a long-awaited victory on the road.
Palace went into Saturday's game on the back of four consecutive wins and were big favourites to beat an Albion side who had lost their last three games, but an early strike from James Morrison set the tone for a surprise win.
Gardner then got in on the act with a thumping right-footed drive after the break and there was no way back for Alan Pardew's men.
Three points moves West Brom above Newcastle United into 13th place and deals a blow to Palace's hopes of finishing in the top half.
Albion had scored just one goal in their previous four away games, but they took less than two minutes to break the deadlock as an unmarked Morrison evaded Jason Puncheon to head home Chris Brunt's corner.
Yannick Bolasie was this week valued at £20million by Pardew and the winger's price tag may have soared even higher had his acrobatic overhead kick not been palmed away by Boaz Myhill as Palace remained on the front foot.
Pardew reacted to his side's first-half display by replacing Jedinak and Ledley with Dwight Gayle and Souare at the break.
Gayle somehow failed to convert a fine cross from Souare three minutes later and Bolasie felt his goal-bound strike was handled as Palace's frustration mounted.
