Les Bleus opened the scoring with a superb goal from substitute Hatem Ben Arfa shortly after the break but Huseklepp levelled by deflecting a free kick into the net before hitting the winner after a counter-attack on 70 minutes.
New coach Laurent Blanc, who took none of France's World Cup squad members to Norway, fielded six uncapped players in his starting line-up for his first game in charge.
"I'm satisfied because I saw players who wanted to play, who played well and respected my instructions," Blanc told reporters.
"The result is not what we wanted and a defeat is never encouraging but I saw many positive things."
The visitors, with Arsenal's Samir Nasri in the playmaking role, came close to scoring several times after that, notably with a diving header by striker Loic Remy.
France's young team looked good when moving the ball forward but lacked composure at the back and suffered at times, particularly during a spell of Norwegian pressure towards the end of the first half.
"After half an hour I thought we would lose this match but afer that we controlled it better and created great chances," said Norway coach Egil Olsen. "I'm really happy about our performance."
