Les Bleus, who made an embarrassing first-round exit in South Africa, saw their campaign gather pace in a packed Stade de France after leaving it late to see off a tough Romania side.
Striker Remy, a 68th-minute replacement for Mathieu Valbuena, fired a low shot into the far corner of the net after a quick counter-attack seven minutes from time.
Playmaker Gourcuff, featuring for the first time since Les Bleus's farcical South African campaign, came off the bench to put the result beyond doubt in stoppage time.
"There is a deep change but it's only the beginning," winger Florent Malouda, who had an on-and-off relationship with former national team coach Raymond Domenech, told reporters.
"We said after the Bosnia game (a 2-0 away win) that we were able to play well. It's good for our confidence because only good results can give you confidence," he added.
Laurent Blanc's side, who started the campaign with an embarrassing defeat at home to Belarus, now have six points from three matches ahead of Albania and the Belarussians on five.
Romania stay second from bottom with two points.
"It is very frustrating because we lost just when we started to control the play but we have to acknowledge France were superior," Romania coach Razvan Lucescu told a news conference.
France's next qualifier is against Luxembourg in Metz on Tuesday.
GOOS START
The home side got off to a good start in Paris with Samir Nasri and Valbuena dictating the play in the midfield, but they lacked sharpness as Romania just sat back.
"The team did not give up, they always believed they could win. I liked this spirit," Blanc told a news conference.
"It was a tough match, we did not create really clear chances in the first half because Romania were well organised and proved solid.
"I told my players a game was not finished after 60 minutes and that it was not forbidden to win it in the final ten minutes."
The home side had their first clear chance in the 19th when, after a fine pass on the turn by Nasri, Florent Malouda fired just wide - it was his only goal attempt in the game.
France had another great opportunity to open the scoring four minutes before the break when Karim Benzema's fine curled shot from the edge of the area shaved the far post.
But the hosts were asleep early in the second half when a Bogdan Stancu cross was struck on the volley at the far post by George Florescu, forcing Hugo Lloris to punch clear.
It spurred Les Bleus back into action but they were superbly denied several times by visiting goalkeeper Costel Pantilimon.
POWERFUL SHOT
Valbuena unleashed a powerful shot from 18 metres that brought a superb one-handed save by Pantelimon who forced the ball up onto the bar before it was booted clear of danger.
