Rousselot, who is also a member of the federal council of the French Football Federation (FFF), made his plea on the eve of an FFF meeting to discuss the team's failure in South Africa.
The 1998 champions failed to record a win as they were knocked out in the first round. Players also boycotted a training session to protest after striker Nicolas Anelka was sent home for insulting coach Raymond Domenech.
"We know the five leaders. They must not play again for the national team," Rousselot told Reuters on Thursday.
Earlier this month former France defender Lilian Thuram also asked the FFF council, of which he is a member, to "sanction the players heavily".
"For instance, captain Patrice Evra must never be called up again," said Thuram who won a record 142 caps for Les Bleus.
"I don't see how a player under judicial investigation could be called up for international duties," he was quoted as saying by the daily Le Parisien on Thursday.
"If Domenech is a gentleman he will go of his own will. Several council members believe he can't stay," Rousselot told Reuters.
