Bundesliga leaders Leverkusen said the operation was to repair cartilage damage for Rolfes, who has only just returned following a three-month injury absence.
"This is a major shock for us," sporting director Rudi Voeller told reporters. "It is especially painful for Simon and we must now give him confidence and support him as much as we can. He must think positively."
Leverkusen said he would be out for several weeks. Rolfes also had two previous operations on the same knee last year.
The 28-year-old, who has won 21 caps since 2007, is looking to take part in his first World Cup in South Africa in June.
Rolfes felt pain in his knee during a brief appearance in Leverkusen's 3-0 win at Hoffenheim on Sunday.
Germany manager Oliver Bierhoff said he was not out of contention for a spot in the World Cup squad.
"One should not hurry to rule him out," Bierhoff told reporters. "We should keep our fingers crossed he comes back and plays soon."
Germany coach Joachim Loew said they would wait and see how long a recovery he would need but ruled out a return to the squad for Torsten Frings.
Loew informed the experienced Werder Bremen midfielder last week he would not feature in his World Cup squad.
"That is out of the question. This was a fundamental decision," Loew told the SID news agency.
"(Rolfes' injury) is a setback for us but we must first wait and see how long he will be out."
'I would love to relive walking out at Wembley in the FA Cup final with West Ham when I was captain': Gilly Flaherty reflects on sensational career
'When Manchester City play it's hard not to be biased as they are my club and I love it when they win - but it frustrates me even more when we get beat' Steph Houghton on the problems of punditry and remaining neutral
