Their progress from an obscure footballing backwater ranked 182nd out of FIFA's 200-odd members a decade ago to a place just outside the top 50 last year is a remarkable rise by any standards.
Compared to club football, their arrival equates to the rise of German village side Hoffenheim, who came from regional obscurity to a place in the Bundesliga in 2008.
Reaching the Nations Cup last eight is reminiscent of Wimbledon, who rose from the anonymity of the English minor league game where the won the old FA Amateur Cup in 1963 to reach the top tier and beat mighty Liverpool in the FA Cup final itself in 1988.
At international level, the achievements of Cape Verde, who with just 500,000 inhabitants are the smallest country ever to play in the finals, will strike a chord in Costa Rica, Trinidad & Tobago and even Cameroon, who they defeated 3-2 on aggregate in the qualifiers to reach the Nations Cup finals for the first time.
All of those countries exceeded expectations to reach and impress at World Cup finals and Cape Verde's performances here will have special resonance in Yaounde, the Cameroon capital.
It was 23 years ago that Cameroon were being feted as Cape Verde are now for their achievements in the 1990 World Cup in Italy when they became the first African country to reach the quarter-finals and only missed out on a semi-final place after a narrow 3-2 extra time defeat by England.
Cape Verde, who gained independence from Portugal in 1975 and only joined FIFA as relatively recently as 1986, did not even start competing in World Cup qualifiers until 2000 but a place in the World Cup finals at some point in the future is now looking a realistic target.
Their achievement in reaching the quarter-finals of this tournament was all the more satisfying for the inhabitants of the archipelago off west Africa given it came thanks to their stunning 2-1 win over Lusophone rivals Angola on Sunday.
At various points during the match, being played simultaneously with South Africa's game against Morocco in Durban, Cape Verde were in, then out then in the quarter-finals as the two games dramatically unfolded.
Eventually Heldon's stoppage time winner not only gave them their first ever victory in the finals but also ensured they finished second in Group A behind South Africa and will be back in Port Elizabeth on Saturday to meet the winners of Group B.
Coach Lucio Antunes said he hoped they would face Ghana.
"We want to compare ourselves against the best in Africa and Ghana are among the best," he told reporters.
"We have already reached one objective here which was to qualify for the quarter-finals, no matter what anyone else thought, and we have done that. Why stop now? We want to carry on."
Antunes is certainly a man to get the best out of his men as the opening draw against the hosts and a subsequent draw against Morocco proved. Both of those teams have far more pedigree than Cape Verde, both are former champions, but there is one thing they lack and Cape Verde possess - a singing coach.
Get the best features, fun and footballing frolics straight to your inbox every week.
Thank you for signing up to Four Four Two. You will receive a verification email shortly.
There was a problem. Please refresh the page and try again.