Les Bleus, who won with a goal in each half from Philippe Mexes and Yoann Gourcuff, now have 12 points from five games, ahead of Belarus, who visit third-placed Albania on Saturday.
Full-back Evra and winger Ribery got bans of five and three games respectively for their roles last year in South Africa where France players went on strike to support Nicolas Anelka who was sent home for insulting then coach Raymond Domenech.
The pair started Friday's match at the tiny Josy Barthel stadium after being booed by 2,000 French fans who had crossed the border and they made low-key comebacks in a dull game.
"They were subdued, just like the rest of the team," France coach Laurent Blanc told a news conference.
"They were a bit shaky. Then it got better. But they did not have the best preparation," he added, referring to the news conferences both players held earlier this week to discuss the World Cup farce all over again.
With France captain Alou Diarra on the bench, Samir Nasri was given the skipper's armband and started as the playmaker with Gourcuff as the holding midfielder.
"We were not exactly brilliant," said Blanc. "But I did not expect a great game so I am not disappointed. What matters is victory and the three points that go with it."
